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Mlnu.es  from,  he  fif.b  Ca./Va.  Pane,  Meeting.  Boulde 


sc  f ,„a  the  minutes  and  associated  documents  prepared  from  presentations  and 
meetings  alThe  Boulder  site  m April.  g our  concepts  for  data  product 

to  significant  progress 

Boulder.  . _ included  herein.  For  those  o 

, W0u,d  like  ,0  call  ,our  •*"*%*£  Act.on^  yku  report  to  me  as  son 

y0„  to  »hom  actions  have  been  a t V t0  the  status  of  those  rtem  . 

as  possible  so  that  1 may  notify  the  g communications  between  th.s 

S22£=£J»  s can. .. — - 
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2:00  - 3:00 
3:00  - 4:00 
4:00  - 5:00 


M.  Chahine 
R.  Kahn 
P.  Bailey 


introduction  to  Validation  Session 
- programmatics,  Objectives 

Validation  Issues  and  Techniques 
Validation  Lessons  Learned  from  UARS 


ThiindPV ftnril  9 


9:00-10:00 

M.  Chahine 

10:00  - 11:00 

j.  Bates 

11:00-12:00 

All 

1 :00  - 5:00 

All 

f ddflY  Ar>lil  ia 

9:00  - finish 

All 

Role  of  GEWEX/GVap  in  Field 

Campaigns 

NOAA/Pathfinder  Data  Sets 
Discussion 

Working  Group  Meetings 
Validation  Charter 


Proposed  Subcommittee; 

In  situ  Data  Group 
Satellite  Data  Group 
Model  Data  Group 

Validation  Techniques  and  Analysis  Tools  Group 

Issues: 


Statistical  characterization  of  data  sets 

Findmg^statistics  that  characterize  key  attributes  of  the  data 

Oefinfng  ways  to  characterize  the  comparisons  among  data 
sets  (Scale  issues,  statistics,...)  u 

Selection  of  specific  intercomparison  exercises 

Seleding^^ra^ereaic  spatial  and  temporal  regions  tor 

Impact  o(  validation  exercises  on  the  logistics  of  current  and 
planned  field  campaigns  and  model  runs 


Preparation  of  data  sets  for  intercomparisons 

Characterization  of  assumptions 
Transportable  data  formats 
Labeling  data  files 
Content  of  data  sets 

Data  storage  and  distribution  (EOSDIS  interface) 
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THERMAL  INFRARED  CALIBRATION  WORKING  GROUf 


BOULDER,  COLORADO 
APRIL,  1992 
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9:00  AM  ^®™pres£nl  EQS  Program,  Impact  on  Calibration 
Discussion 

Agreement  on  Agenda 


9:30 


w 

CROSS-CALIBRATION  AT  THE  INSTRUMEOT  PROVIDERS 
C.  Palmer-Limits  to  Radiometnc  Accuracy 


10:00 

10:15 


BREAK 

H.  Ohmai-  ASTER  Subsystem  Calibration 


10:45 

i£-45  Ih 


RCULATING  REFERENCE  RADIOMETERS 
Status  and  Development  Schedule 
C.  Johnson-Role  of  NIST  in  TIR  Calibration 


11#5 

C 11:30 

12:00 


cross-calibration  at  the  s/c  integrator-overview 
Present  plans  at  GE  _ 

Utah  State-Cross-Calibration  Target 

LUNCH 


1:00 


1:15 


2:15 


4:00 


IN-FUGHT  CROSS-CALIBRATION 

Y.  Yamaguchi-  In-flight  Cross-Calibration 


CALIBRATION  PEER  REVIEW  PROCESS  AND  CONTENT 
Discussion 

THERMAL  IR  CALIBRATION  WORKSHOP 
& % Review  of  topics 
| ^ Utah  State  Presentation 
I * Discussion 

, BREAK  AT  APPROPRIATE  TIME 

CALffiRATTON  HANDBOOK 

Review  of  function,  need,  contents 

1 Discussion 


minutes  m 

EOS  calibration/validation  pane 
PLENARY  SESSION 

April  8,  1992 
Boulder.  CO 


, He  introduced  Mitch  Hobish,  of 

Bruce  Guenther  called  the  plenary  sessic » to  order* ,,,  Executive  Seeretary.and 
Research  and  Data  Sys  ems  Corporation  (RDC)  as  the  a / ' ( of  s cross.Calibration  plan, 

distributed  minutes  from  the  fourth  Cal/Val  j ,h°c  nced  for  development  of  data 

„d  a draft  Data  Product  that  minutes  for  the  current 

product  validation  policy  over I'l!«eka of Adjournment, 
meeting  will  be  available  within  two  weeKS  j 

p ti,e  Reflected  Solar  Calibration  Working 

At  8:15.  Bruce  Barkstrom  Presented  the  report 
Group  (WG  A)  meeting  of  April  7,  iwi. 

Reports  from  relevant  instruments  had  been  fouJ^re delayed*’  discussed  were  the 

Five  instruments  were  classed  as  hurryi  8 ’ calibration  geometry,  including  the 

philosophy  of  calibration;  calibrat.o ««  error  budgets;  and  calibration 

instrument  itself,  chambers,  and  s°ur«s'e"f'2Js  including  instrument  data  reduction 

calibration^  dlita^Te^ctton^n^procedurc  outf  ines^  ^ ^crosscalibra'tion) 

characteristics,  and  mathematical  models. 

■ . ,,  vnp  :<  woe  strongly  recommended  that 

In  regard  to  personnel  for  calibration  review  « action  items  are  all  drivers,  and 

calibration  representatives  be  on  review  one  science  member, 

would  influence  the  project.  It  was  suggested  tha  P . d be  aWc  t0  submit  action 

tnPd  volunteers  from  the  science  community I shod  d »'<'"^”Vs  some  discussion  of  length 

items,  to  be  cleared  before  adjournment  of  the  rev, e^^Ihere  ^ review5  for  the  PDR 

of  time  necessary  for  adequate  revi  . . length  of  calibration  review,  but  it  was 
process.  No  conclusion  T“c^'d„  "1  2s  part  of  the  PDR  process  would  make 

2:ra"yonCmore“  WsIblPVo  "Sich  in  itself  was  deemed  necessary. 

With  reference  to  the  Calibration  mill  w“rt»dly-'Sy 

was  being  generated.  The  group'  0 1 * *£  distribution  of  the  handbook  is  the  desired 

making  it  readable  and  accessible  Electronic  d.str.o  , /f#rmtt  j„  2.3  weeks,  and 

PnhoVgh.^’ 'nTe'dfor  standard  Nation, 'especially  in  r'egard  to  e-mail  transfers  was  addressed. 
At  8 45  John  Gill,  presen, ed  the  results  of  the  April  7,  .997  meeting  of  the  Thermal  Infrared 

Calibration  Working  Group  (WG  B). 


of  the  review  panel  included  team  members,  calibration  WG  members,  project  engineers  NIST 
and  community  representatives.  The  review  should  be  not  later  than  PDR  and  CDR,  although 
this  could  be  a matter  of  negotiation  between  the  PI  and  the  Project  Scientist.  The  desired 
output  from  such  reviews  would  be  a formal  report  by  the  peer  panel,  submitted  to  the 
engineering  panel.  This  report  could  include  action  items  and  suggestions.  What  was  found  to 
be  needed  for  refinement  of  such  a plan  was  charter  and  a charge,  and  a method  of  coming 
o closure  on  action  items.  The  group  also  felt  that  the  contents  of  any  presentations  to  a 
review  panel  should  be  consistent  with  mandated  calibration  plans. 

St8t'd  that  thc  0utput  of  8 caIit>™ti°n  Plan  Is  not  necessarily  consistent  with 
extranVoncmallir'I?ent5^PlanS  *rC  usuaI!y  designed  to  produce  schedule,  often  contain 
^ ‘ 8\d  d°  n0t  contain  critical  science  items.  ERBE  documentation  shows  this. 

J 'VSSf  s.uch  a document  were  assigned,  it  would  be  done,  but  that  it  is  not  on  the 

A,  ' AT, -.i LIV  »Su,me'  B!rkstron!1  wondered  who  would  pay  to  accomplish  action  items,  and 
J"hat  t0  bc  negotiated  with  GSFC  Project.  Guenther  stated  that  is  was  his  job  to 

“***  . things  gct  done*  and  that  assignment  of  an  Action  Item  implies  responsibility  for 
Payment.  * 

Gille  then  discussed  material  that  WG  B felt  should  be  covered  in  peer  reviews  (pre-PDR/CDR) 
with  particular  relevance  to  the  AO-mandated  activities  (see  APPENDIX).  Their  outline  was 

generally  congruent  with  that  of  WG  A.  5 

Z?r^oSl  'uggcst'd  tha.1  PRBS  Prcscnt  summary  of  their  PDR  presentation  at  next  Panel 
meeting  m September,  with  preliminary  presentations  by  other  instruments.  Guenther  stated 

meeting  ^ d,SCUSScd  as  no  separate  TIR  meeting  as  such  is  planned  for  the  September 

Next  was  a discussion  about  calibration  peer  reviews  relative  to  engineering  PDR/CDR  It  is 
W?"CC^«iiVefymon  rCV‘CW  pancl  mcmbcrs«  and  not  just  to  have  a paper  trail 
runs ‘reviews  TBD’  Guenthcr  wi)1  confcr  with  thc  GSFC  Code  300  representative  who 

rh,uriiePOd  °f  T1R/W.G  B ac*ivities  of  the  previous  day  followed,  with  a generalization  of 
frmr  fnit”6-  S pr*se"tat,on/rc.su|ts.  The  conclusion  was  that  there  is  no  substitute  for  careful 

n ' r'Kmc1'' thCrC  15  3 nCCd  f0r  CarefuI  Panning,  and  analysis  of  resultant  data 
based  on  thc  1SAMS  experience  on  UARS.  Stray  light  problems  also  must  be  attended  to. 

t^re^durL^l^n^  W2h  0hl?ars  .technique  for  raising  temperature,  and  the  measurements 
t?m^nd«rh-f  TK-  K8  and  1 cooitng  in  order  to  track  changes  in  instrument  performance  over 

time  m orbit.  This  brought  on  a discussion  about  thermometry,  and  problems  with  PRTs.  Bob 

thaf2V/-°TC!fCd-th‘rthlS  Y discussed -•»  and  with  the  larger  group.  Many  present  felt 
shmi M h? I*'™??  a,*n,f,cant  J***  available,  including  on-orbit  data,  and  that  such  data 

that  the  r0m’  C'8'’  NIST*  yKii»aTd  others-  Thcsc  data  indicate  some  drift,  but 

that  the  observed  changes  may  not  be  PRTs,  and  could  be  geophysical.  This  must  be 

statYment6?'  v"  W3S  discu.ssion  of  0hmai’s  mathematical  model  of  ASTER,  with  a 

Yew^naeefrcrPm.agUChl  cpncernin8  crMS-calibration  of  ASTER  that  the  instrument  doesn’t 

fields  mioh,  Yt-  n°  C°  d targCt‘  Hc  con eluded  that  appropriate  views  of  snow  and  ice 
iieids  might  serve  this  purpose. 


At  9:20  Dr.  Ono  Presented  his  response  to  an  Action  Item  from  the  previous  Pancl  meeting  He 
discussed  status  of  JERS-I  (i.e.,  i,  is  in  good  shape  despite  some  problems  with  SAR  .menna) 

"C.?',?d:SCUS“d  thc  VIS/NIR  and  SWIR  transfer  radiometers  developed  at  NRLMfor  pre-  and 
post-flight  calibration,  especially  in  terms  of  avoiding  mistakes,  relative  consistency,  and 


absolute  accuracy.  He  described  two  levels  of  comparison:  at  instrument  manufacturers  and 
at  the  platform  integrator’s  site  with  comparison  at  national  ,abs»  an^ls®uss®dJounp^^’" 
measurement  procedures.  General  discussion  led  to  a consensus  that  1%  should  be  a common 
goal  for  all  instruments.  Ono  presented  of  VIS/NIR  and  SWIR  transfer  radiometers 
constructed  for  ASTER  comparisons,  and  presented  data  on  loag-tenn  stabil ity  of  these 
radiometers  over  1.5  year  span.  It  varies,  but  typically  within  1%  over  1.5  yew*.  One 
radiometer  was  examined  over  6 years:  it,  too  was  typically  within  1%  *P®ctral  radia“«c- 
Spectral  characteristics  appear  stable  over  a 6-year  period  on  a log  scale,  but  on  a linear  scale 
there  is  some  shift,  which  translates  to  0.3-0.4nm.  Industrial  radiometers  show  larger 
size-of-source  effects.  He  then  showed  recent  data  on  round-robin  comparisons  over  7 sites, 
compared  with  a national  lab,  and  his  lab.  There  were  small  deviations,  but  well  within 
"allowance  level,"  i.e.,  <1%  of  radiance  scale.  The  conclusion  from  this  exercise  was  t a 
round-robin  measurements  can  demonstrate  procedural  errors,  and  indicate  ways  to  improve. 
He  concluded  that  round-robin  measurements  must  be  done  more  than  once,  as  the  first  is 
basically  a try-out;  the  second  is  required  for  good  data. 


General  discussion  led  to  agreement  that  more  than  one  trial  is  required  A question  was  raised 
in  regard  to  whether  the  radiometer  lens  was  cleaned  properly,  in  that  dust  can  make  a stray 
light  effect;  were  procedures  in  place?  Ono  stated  that  these  results  were  not  from  a ®|*an 
room.  He  stated  that  a detailed  calibration  manual  has  been  prepared,  and  that  humidity 
control  important. 


At  9:55  an  Action  Item  Review  from  the  fourth  meeting’s  Items  was  presented. 

4.01:  TBD  in  peer  review  process 

4.02:  open  item 

4.03:  no  action 

4.04:  no  action 

4.05:  closed 

4.06:  instruments  to  provide  short  version  in  response  to  item  identified  Barkstrom’s 

materials. 

4.07:  open  item  (??) 

4.08:  partially  closed.  Input  f or  mature  cross-calibration  plan  needed  in  4-5  weeks  to  provide 

input  to  GE  for  their  planning  purposes.  A final  plan  is  not  needed  at  that  point. 
There  was  some  discussion  re:  GE/AM  platform  specific  plan  vs.  project-level 
cross-calibration  plan  with  embedded  specifics  for  each  platform.  A mid-May 
timeframe  would  be  great  for  overall  plan.  The  time-sensitive  issue  is  GE-specific; 
however,  a general  statement  is  needed.  Guenther  will  do  AM/PM  specifics. 


4J0:  (Now  combined).  The  five  AM  instruments  should  meet  during  the  week  of  6/8(?)  at 

GE  for  a one-day  meeting  for  accommodation-specific  issues,  and  vacuum  chamber 
needs  review.  An  agenda  is  to  be  distributed  4/24,  with  date  selection  to  be  2 weeks 
later. 


4.11:  scheduled/closed. 

4.12:  open 

4.13:  open 

4.14:  open 

4.15:  open 


The  group  took  a break  at  10:25,  and  reconvened  at  10:35  with  a Project  Science  Office 
(Calibration)  Report  by  Bruce  Guenther,  and  a discussion  of  the  relation-ship  to  CEOS  Working 
Group  on  Calibration  and  Validation  (WGCV)  (see  APPENDIX). 

NASA  wIH  provide  terms  of  ref  erenceTor  passive  microwave.  So  far  the  Calibration  Panel  has 
been  relatively  unsuccessful  in  generating  critical  mass  of  interest  in  this  topic,  although 
CEOS  is  interested.  A general  discussion  concluded  that  ESA  is  relatively  inexperienced  with 
respect  to  passive  microwave  calibration.  The  solution  is  to  have  suitable  representatives  across 
the  EOS  program  involved  in  process.  The  chair  of  that  activity  may  be  US  individual,  as 
NASA  has  the  responsibility  to  make  microwave  activities  happen.  Guenther  then  presented 
the  agenda  for  the  next  meeting  in  Abingdon,  UK  (May,  1992). 

Next  to  be  discussed  were  cross-comparison  issues,  such  as  sources,  and  radiometers.  Guenther 
stated  that  there  was  no  need  to  discuss  this  in  depth,  as  it  had  already  been  discussed  during 
this  meeting;  however,  it  has  not  yet  been  discussed  (publicly)  how  it  will  be  done,  what  is  the 
cost,  etc.  Guenther  has  asked  everyone  who  wants  funding  via  the  PSO  to  provide  a 1-2  page 
proposal  letter— by  end  of  this  month-describing  the  nature  of  planned  of  activities,  hardware 
to  be  built,  proposed  schedule,  and  an  estimate  of  how  much  it  will  cost.  Since  the  University 
of  Arizona  activity  is  under  MOD1S  and  other  activities,  Guenther  is  not  expecting  anything 
from  Phil  Slater.  The  Japanese  group  is  going  forward  with  their  own  radiometer  activities, 
so  again,  no  letter  is  expected.  He  does  expect  a letter  from  NIST  on  concepts  for  building 
VIS/NIR  and  SW1R  radiometer  hardware,  and  possibly  another  supporting  TIR  radiometer 
approaches,  and  still  another  on  VIS/NIR  SWIR  source  (s).  Langley  should  produce  one  on  TIR 
radiometers  and  sources,  and  Utah  State  University  should  produce  one  on  TIR  sources.  All 
of  this  should  be  put  the  cross-calibration  plan,  and  distributed  for  comment.  Guenther  then 
opened  the  floor  for  discussion  and  comment  about  cross-calibration  issues. 

Robert  Lee  asked  who  will  provide  common  information  on  spectral  characterization  of  all 
filters,  and  asked  if  anyone  had  experience  with  Fourier  transfer  interferometers,  especially 
since  he  was  interested  in  measurements  beyond  18tm  to  longer  wavelengths 

Guenther  stated  that  WG  A is  recommending  going  to  each  AM  platform  instrument  team  in 
the  process  of  procuring  flight  filters  for  launch  and  asking  some  group  to  seek  additional  sets 
of  filters  (subset  of  channels,  full  set)  in  a common  mechanical  format,  1"  diameter,  built  to 
flight  specs  (or  similar).  This  creates  a residual  inventory  of  filtersthat  match  the  bands  of 
flight  instruments,  and  would  be  made  available  on  a circulating,  6-month  basis  for  use  in 
labs/field  tests  as  part  of  the  Calibration/Validation  program.  There  is  also  the  possibility  of 
having  one  or  several  central  locations  to  make  measurements  on  filters,  and  make  those  data 
available.  An  open  action  item  is  how  expensive  is  it  to  get  extra  filters  at  the  time  of  flight 
filter  production?  One  issue  is  that  filters  that  are  available  are  not  radiation-hardened.  In 
addition,  there  are  no  filters  beyond  17im.  The  Action  is  on  each  instrument  group  to  find 
costs  for  their  own  filters. 


m 


Next  to  be  discussed  was  the  ?»ta  Pr0.d” highlight  paradox  existing  in  program.  As  it 
of  a policy  statement  was  provided,  pnm  y 8 8 P start.  Guenther  stated  that 

stands  the  draft  policy  is  inadequate ^ but  it i ^seen  as  a p^^  ^ ^ ^ wouldlook 

details  would  be  presented  later  during  * . . ' on  what  data  product  validation  should 

at  all  provided  material  and  begin  formula  ___  j^g  a recommended  data  product 

be  The  goal  of  this  activity  is  to  reviews,  esp.  CDR.we 

validation  policy  for  EOS.  On  the  basis « * M Jr  p00rly.  It  may  not  be  this  panel’s  f!Ta 
will  judge  whether  people  are  doing  their  j°  issues  and  to  lay  the  groundwork.  The 

charge  to  do  this,  but  we  have  responsibility  to  open  up  MouS  chahine  as  part  of  a 

group  is  to  provide  written  comments  to  Bruc*^U.  i5stic(financially)  based  on  limited 

U°sen“»s  process.  I.  w ,s  rcuested I SUM  the  .hat  members  be  realistic 

funds,  especially  with  espect  to  AO  statements.  It  also  i ^.entilt^  name  on  a data  product 
about  the  impact/impl  cation  of  havingthe^(or  so  th  whh  no  funds  available  past 

having  gone  thorough  quality  control  forthcfirst  t>  moni  ^ Gucnthcr  and  Hoblsh  t0  submit 
that.  Inputs  over  course  of  the  next J®0”1  n_ram  office  at  HQ  for  comments.  After  one  more 
to  Chahine,  Gille,  Barkstrom.  and  the  icw  by  Panel  members.  If  consensus 

revision  it  should  be  a relatively  mat“rc.^l  d p’r0oram  Office  for  submission  as  validation 
Is  then  reached,  it  will  be  taken  tq  the  iw°  a SUtcment  about  the  right  role  or  the 
&ioiM^' UnS^Sn6  for  development  of  how  data  prodoe,  vabdatron 

activities  will  develop. 

Discussion  followed  concerning  the  timescale  t. or  policy ^ SrfVoVjnly' 1«  should 
Kd be  ready  for  the  1WO  Process.  Gille  ashed  if 

« a panel,  or  if  a separation  was  r.d.cated, 

Guenther  said  to  keep  them  together. 

Guenther  and  Gille  then  discussed  the  possibility  of  holding  evening  sessions  a,  future 
calibration/validation  panel  meetings. 

Bruegge  remarked  that  it  appears 

calibration  meetings  than  they  do  at  these  EOS  calibration  issues.  Very  little  calibration 

instruments  look  to  MOWS  for  ^ that  WG  A meet 

MSS  wiX  Spence  Team  Meeting. 

Labsphere  representatives  indicated  that  would  be  willing  to  host 
calibration/validation  meeting  in  New  Hampshire. 

of  September  i^Lo'gTn^UT8 fi^c^njun^iot^wit^e^^  Sensor 

Calibration  Conference. 

At  12:30  the  group  was  presented  whh  a demonstration  of  OASIS  Software  by  University  o 
Colorado  personnel  (see  APPENDIX). 

The  panel  broke  for  lunch  at  1:15. 

This^sessfo^as”  h^r^byMous^ChariM^Thy'rtssitm^aro^^w^t^hcfp  dc^ne^what  wc 
mean  by  DPV  (see  APPENDIX). 

Chahine  proposed  that  DPV  is  an  error  bar  with  reference  to  . surface  standard.  For  example. 


one  could  compare  remote  sensing  data  with  in  situ  data  using,  e.g.,  radiosonde  or 
rawjndsondc-derived.  data.  He  stated  forcef ully  that  we  must  be  careful  about  what  we  assume 
js  truth.  The  operational  question,  then,  is  how  best  to  define  DPV? 

Haskins  suggested  that  validation  roust  take  Into  account  long-term  and  day-by-day 
measurements,  including  process  studies.  This  was  followed  by  a discussion  of  error  bar 
problems.  The  consensus  was  that  relative  statistics  along  with  absolute  must  be  provided  If 

accuracy  can  t be  met,  then  an  unchanging  metric  (even  with  a built-in  bias)  may  be  useful 
anyway, 

«!!nrfla!?^drbc  q“estion‘.  do  811  instruments  have  their  own  standards,  or  can  we  agree  on 
h^tur»»n  S Xpcncncc  AIRS  shows  that  even  within  an  instrument  there  arc  difficulties 
onlv  t r«  I^eIltSii/Standards  8re.necessary,  but  not  sufficient,  and  that  any  standard  is 

measure  i * Tr15*  dca^  w*tb  statistical  properties  of  the  parameters  we  wish  to 

JTbservJ if<J-?lf‘COn,,,t?ncy  of  8 d8ta  sct  ovcr  thc  time  and  space  we  wish  to 
Th?s  led  ?*d  ,f  7CuWCfC  discussin*  first-principle  error  bars  or  heuristic  error  bars? 

7?, £,!*?„ *°. 8 d,scu5Sion  of  absolute  vs.  relative  validation.  Chahine  stated  that  zero-order 
dation  involves  looking  for  and  finding  an  in  situ  measurement.  Second-order  is  to  compare 
n trCndS’  cIin;ato!oSy-  variations,  etc.  Third-order  is  how  well  can  one desXe- 

.basis*'samc  pr  related  parameters  to  what  you’re  dealing  with?  He  also  stated  that 

Joined  V?S, ‘T ter*sPec,flc  wd  that  we  must  ask,  therefore,  which  parameters  can  be 

grouped  for  validation  purposes  and  by  which  standards? 

^cr°n,c:udcd  that  daia  p,a!cd  on  E0SDI?  as  8 standard  '*«  must  have  associated  error  bars 

Jf^«rf,!mi,,I5trTCn!ld.CACndCn  u8nd  thcn  Pararaeter-  dependent.and  that  long-term  stability 
of  instruments  and  model(s)  must  be  taken  into  account.  Indeed,  we  really  need  two  error  bars- 

This  is  likcl>  unnecessary  for  each  measnremen..  since  .rends 
important  here,  but  the  concept  must  be  addressed. 

In  order  to  address  these  issues,  Chahine  proposed  the  following  subcommittees: 

validation^  *r°UP:  *°  d?al  Whh  standard  "yard«ick-  determination  (zero-order 
Satellite  data  group; 

Model  data  group:  to  deal  with  level  II  validation/models.  3-6h  forecasts,  etc.;  and 

- *"»“  vou  .o 

er0“PS  **•  Wi"  — and  - -por,  back  ,0  .he 

Gautier  asked  for  a clear  statement  of  the  charge  to  these  subcommittees,  what  specific  data 
sets  should  be  obtained,  and  what  parameters  should  be  addressed?  Chahine  said^o  look  for 

MODIs"  CE  R ES  * etc'  VacTc  ^ " * V^M^r*0  valiJatc  cloud  forcing  between  AIRS/AMSU, 
mudis,  CERES,  etc.  Each  group  should  define  a charter.  We  could  then  see  how  thev  all  fit 

together.  There  was  some  discussion  as  to  the  size  of  the  subcommittees!  whVh  ,ed to  a 

discussion  as  to  the  reasonableness  of  this  as  an  approach,  since  there  are  over  200  parameters 

o c examined,  Gille  asked  to  hear  from  each  team  their  approach  to  validation  especially 

since  .here  appears  to  be  little  indication  (hat  .he  teams  have  undertaken  this  eiweise  sia  « 

asked  tf  representation  from  IDS  groups  was  needed,  especially  if  we  are  addressing  level  3 


Chahine  stated  that  letters  had  been  h*e”J’h errwasno  ^Utt  *««P^  A.*h«w  ®f 

Calibration/Validation  Panel  “““CCattendees  out  of  25  groups.  Chahine  opined  that 
i^=rl»:o^“hen, get  involved. 

Neat  on  the  agenda  was  a presentation  by  Ralph  Kahn  on  VaUda non  >“»“  *jg mRS2/M5U 

based  on  the  experienee  of  the  1 '^*Plo»  »' ^^SS5«d  by  the  Panel.  «g 

cloud  parameters  (see  AP^EN^1X)*.Th  h t of  thc  £0S  activities  may  operate.  The  main 

SSU  based  on  first  principles 

The  Panel  took  a break  at  {jars  (^'c'aPPEN  DIX)^  ‘ PreS““,“>"  **  P‘“'  Ba,l'y  “ 

Validation  Lessons  Learned  from  UARS  (see  Ar 

. . . a »„  apt  ms  investigators  involved  early  and  often, 

Bailey’s  presentation  emphasised  the  need a * val^atio„  plans,  etc.  He  was  most 

despite  their  own  antipathy  and  a^'^"‘„[“kes  of  others  and  that  EOS  (or  any  other 

Cd  CCl  of  the  -corporate  memory 

from  experience  with  missions  such  as  UARS. 

The  Panel  adjourned  at  5:20PM. 


Minutes 

Reflected  Solitr  Working  Group 
April  7, 1992 


Se  *•' 

nlu  is!  r TL  E0S  AM  Project  Scientist.  The  PM  Project  Manager  is  Martv 

tcZlZT*  f0:  thC  Chan?bcf  arc  1%  in  ‘ visible  and  a3%  in7hc  long  wave  irThe 

held  in  mid-Junet19WenTi«  ERMninsfUn<^  ^1°'  ]"2*  Thc  PDR  for  CER£S  will  be 
f jy92'  The  ERBE  instrument  had  scan  dependent  offsets  in  its 

d,„  now.  CERES  is  working  ...*£ 

Th e°on toard  c a ll br a t i on  d^es i*g  n ^MISR^arnot  Ci^ISRrth%JCC-0mC  * project  Within  JPL- 

=rc- 

report.  MISR  win  be  thc  driver  on  the  size  «f tb.  ri  ?f  °V r,e,d-of-view  comparison 
what  type  of  radiances  are  assumed  in  the  mkp  C *rf  migrating  sphere.  PhiJ  Slater  asked 

to  calculate  MISR  signal-to-noise  ratios  Br,.e««V  A"  / ; .l?e.MISR  radiances  and  as  a tool 
calibration  facility  at  JPL^ »nd 1 e88«  Pr/sented  tnformation  of  the  photodiode 

nra.criais  Bomob  of  "oW*e«, ^Ziaric  0^1’ h^a,i°i  °”  ,he  pr0|,er,its  of  dirf“!« 
design  for  MISR  has  spectralon  coated  with  indium^!^  baseline  diffuser 

diffuser  must  be  characterized  for  soace  fif.h»  i«  dCA  Howcvcr* th,s  type  of 

a specular  peak  in  the  BRDF  for  ITO  eoar<*rf  cn-n  1 1 L°n%  ^aro  c Prcsented  data  showing 

wavelengths  ITO-coated  spectralon  that  was  more  pronounced  at  longer 

rtai  SAG^IIirwn/begilnyhaseaCD0with1nnSie!Be*tetCa*'*,rat*0n  °f  SAGE  n,‘  »' 

HI  is  scheduled  for  .he  ?Mrd  ,u?“e7of  im  ° *nd  ’h,,,  ,he  PDR  SAGE 

Barbara  Grant  spoke  about  activities  of  the  MODIS  characterization  qk. 

.npu.  fron,  ail  inieres.ed  parries  .hour  .he  MODIS 


are  currently  being  compiled. 

ianA—  -« 

",&.' 2X^1  tS&S  S CrolcVre,,.-.  diffuser  r.ud.e, 

Catherine  Gautier  spoke  on  AIRS,  whichisscheduled  *®r.y*£^ent  that  is  primarily 
She  works  on  the  visible,  short  wave  portion  of  AIRS^  ^Jy  much  of  thc  work  from  MODIS 
dedicated  to  long  wave  u measurements.  S performed  by  LORAL.  AIRS 

to  her  own  calibrations.  Preflight  calibration  of  AIRS Iwi  £ cross-calibrations  with 

will  me  several  Inflight  calibration  «»»  f'°m  \VHRR 

£25  CSadPS.he%es^‘s  f 

ezz,  - tesxi  «*  ^ surtacc  for  vicarious  ealibra,‘on 

the  instrument.  . . 

Chris  Cronter  of  NIST 

f„fS  SSSS^A.  willing  to  calibrate  the  transfer  standards. 

^r^ject^has^bee^ pVt  tn^inoth^l^^^b^rM^^erted  Ute^^ere^as^been^signTficant 

migration  of  HIRIS  personnel  to  the  M1SR  project. 

Denny  Onto, a front  Wes, in, house  spoke  - 

scheduled  for  launch  in  1997.  and  the  .nstrumenMs  ;.^fhatPmeasures  solar  flux  as  the 
will  carrry  inflight  AVHRR  project  are  looking  for  5%  absolute  accuracy 

instrument  passes  over  the  p durina  flight.  Ometz  will  be  performing  studies  i 

fnror^S  with  those  working  on  the  EOS 

instruments.  . 

Stuart  Bigger  spoke  on 

im^H'^^They^recinrVn^con^UucUng  aP«licor^QEJ^basc(^iM  l21”' 

operated  from  0.4  to  1 tm.  0^"^"^c  . acd  fof  operation  at  ambient  temperature  and 
The  instrument  under  construction  is  de  g * * P bc  dc$igncd  t0  operate  m a 

pressure.  Stuart  Bigger  needs  to  I enow ^.f  th. frQm  the  sourccs  that  he  will  measure 

vacuum.  In  addition,  he  nee  s He  also  needs  to  know  the  schedules  for  the 

over  the  wavelength  ranges  of  ■">««'•  »'  measurements  of  the  interference  f.lters 

calibration  of  the  flight  ms, T w.!(h  “^odjfied  CARY  spectrometer,  using  the 
in  the  Arizona  instruments  wil  d ,H  tadiometers.  Stuart  would  also  like  to  have 

thTcf  f icienc^of^U  trapse, ectors  measure!  at  N1ST.  , 

Hugh  Kieffer  spoke  on  lunar  calibrations.  He  reported  that  his  project  was  on  schedule  or 


the  development  of  the  ground-based  instrument.  The  project  has  initiated  procurement  of 
the  detector  for  visible  measurements,  and  the  design  of  the  telescope  is  near  completion. 
Kieffer  anticipates  the  start  of  measurements  late  in  the  summer  of  1993.  Three 
instruments  (SeaWiFS,  MODIS,  and  HIRIS)  have  indicated  that  they  will  use  lunar 
measurements  as  part  of  their  baseline  calibration  requirement.  Kieffer  is  interested  in 
establishing  a set  of  wavelength  bandpasses  for  his  observations.  He  is  estimating 
measurements  in  6 to  20  bands.  Hugh  has  been  providing  values  for  lunar  radiances  to 
those  3 instruments,  so  that  their  gains  can  be  set. 

Akira  Ono  presented  a brief  discussion  of  the  ASTER  calibration.  He  listed  the  set  of 
requirements  that  have  been  given  to  the  contractors  who  will  build  the  instrument.  Ed 
Washwell  commented  that  the  tight  tolerances  of  those  requirements  could  lead  to  a very 
expensive  instrument,  even  by  EOS  standards. 


Bruce  Barkstrom  presented  a list  of  calibration  topics  to  be  covered  at  the  instrument 
PDR’s.  Barkstrom  also  asked  for  comments  from  the  working  group  about  this  list.  The 
PDR  topics,  as  approved  by  the  working  group,  will  be  presented  as  an  appendix  to  these 
minutes.  Hugh  Kieffer  stated  that  he  would  like  to  know  which  items  can  be  measured  by 
each  instrument  post-launch,  as  opposed  to  those  which  must  be  determined  from  pre-launch 
measurements  and  calculations.  Barkstrom  then  discussed  the  selection  of  review  panel 
members  for  the  calibration  portions  Of  the  PDR’s.  Barkstrom  strongly  suggested  the 
inclusion  of  1 project  member,  1 science  member,  and  volunteers  from  the  science 
community  on  the  review  boards.  Carole  Bruegge  recommended  that  the  complete  set  of 
action  items  from  each  PDR  be  assembled  before  the  completion  of  that  review.  This 
practice  is  generally  followed,  but  the  panel  strongly  endorsed  closing  the  action  item  list  at 
the  end  of  the  review.  The  panel  agreed  that  the  calibration  PDR’s  be  handled  as  a peer 
review  process  and  that  the  calibration  PDR’s  be  contiguous  in  time  with  or  included  in  the 
engineering  PDR. 


Bruce  Barkstrom  led  a discussion  on  the  fate  of  the  calibration  handbook.  It  was  decided 
that  the  handbook  remains  an  important  product  from  the  panel.  Barkstrom  expressed  the 
desire  for  the  project  to  more  actively  coordinate  its  preparation.  Bruce  Guenther  took 
responsibility  for  the  slow  progress  of  the  handbook;  he  also  pointed  out  that  no  work  is 
waning  to  be  done  on  the  handbook  at  this  time,  Hugh  Kieffer  recommended  that  the 
handbook  include  the  references  (sources)  for  detailed  information  from  each  instrument 
and  include  the  traceability  of  the  absolute  calibration  for  each  instrument.  He  suggested 
that  the  person  to  coordinate  this  part  of  the  handbook  would  be  from  the  EOS  project. 
Carole  Bruegge  suggested  that  each  instrument  present  the  same  information  topics  in  the 
handbook,  that  is,  that  the  handbook  have  a consistent  format  for  each  instrument. 

Hugh  Kieffer  proposed  a plan  to  coordinate  the  bandpass  filters  for  the  radiometers  in  the 
cross  calibration  of  the  EOS  instruments.  A copy  of  that  proposal  is  included  as  an 
appendix  to  these  minutes.  The  delivery  schedule  and  cost  for  these  filters  remains  to  be 
determined.  For  each  selected  narrowband  filter  it  was  decided  that  10,  1-inch  diameter 
filters  be  produced  for  cross  comparisons,  the  total  number  of  bands  in  this  set  was 
recommended  to  be  around  seven.  Bruce  Quenther  recommended  that  the  information 
about  these  filters  be  coordinated  by  Carole  Bruegge  for  distribution  to  the  instrument 
managers. 


Minutes 

Thermal  Infrared  Working  Group 
April  7, 1992 

. _ pjii.  The  agenda  was  briefly 

The  Thermal  Infrared  working  group  was.°b7oMndusion.  Gille  referred  to  the  recent 
lucussed  with  no  additional  items  suggested  for  inclusio  j d by  the  Congress 

ScXS  for  fUght  in  the  «sponded  that  «deselect- 

comment  on  EOS  pr(  gram  f?st'uct“”®g  Ja * ® pc  of  the  science  that  could  be  donc;a"d 
ion'  of  certain  instn  ments  had  reduced  *«!d  understanding  global  climate  change  as  the 
that  the  emphasis  wi.s  now  on  measuring ^and  i w6cnx tons  would  become  6 
iod  oriority  activity.  Two  large  observatories  was  pnc  Qf  implementation  rather 

platforms  with  lower  overall  capabiluy, but  th  h ng  unchanged  organization, 

than  style.  The  mission  remained  as ^ l0”  1 * ^would ^replace  Stan  Wilson  as  Program 
but  with  some  routine  personnel  changc*-  NOAAi  Jeff  Dozier,  Project  Scientist  at  GSFC, 
Scientist  at  NASA  HQ  (Wilson  is  moving  {hc  vacancy  will  be  filled  through  open 

will  return  to  UC  (Santa  Ba.rbara)  at  GSFC,  with  Guentheras 

competition.  Chris  Scolese  ,sfttbcft^;a®Csr  Tompson  perform  equivalent  roles  for  the  PM 
project  scientist.  Marty  Donoho' and^csd  £intcd  Mitch  Hobish  to  take  over  Guenthers 
platform.  Guenther  announced  that  he  had  PP  n aJjd  Data  Product  Validation  Panel, 
responsibility  as  Executive  Secretar '*["*“*  working  groups  need  to  consider  the 
effective  immediately,  and  noted  x DR  Thesc  w}il  begin  in  June,  1992,  with 
topics  to  be  reviewed  at  "Pcoming  PD  ^ Jh  platforni  PDR  in  January  or  Februa  y 

PDR,  and  will  complete  the  first  phase  wnn 

1993 

enris  Palmer  reviewed  limits  ,0  Xl  ST"* 

his  remarks  with  references  *******  ^ore  or  unde'restimate  various  small  effects 
radiance  to  output  counts,  is  tt*ua,,y  *?.  f apcrCent  of  full  scale.  Such  effects  include 
that  are  significant  at  the  level* * Interdependence  of  telemetry  equation 
nonlinearity,  non-additive  detector  f and  uniformity  of  illumination  of 
parameters  such  as  spectral  response  and  ° • t cffccts  can  amount  to  several 

the  entrance  aperture.  The  “"  JSS" attention  has  been  paid  to  their  exclusion  and 
tenths  of  a percent  even  when  careful  « bc  considcrably  more  important  in  the 

characterization,  and  that  stray  ig  h as  thermometry  uncertainties, 

error  budget  than  more  traditional  eulP«t  , .f.  t source  of  uncertainty,  particularly 

Radiometric  offset  measurement  is s another ^s  gnif^  measurcd  while  observing 

at  low  target  radiance  levels.  D\ff®rcnc  h aa°b  significantly  different.  Palmer  noted 
xpace  and  in  effect  £ ; p'c  Inaignificanffor  1SAMS. 

that  polarization  ell ects  weic 

. acter  TIR  subsystem  calibration.  An  internal  blackbody  at 
H.  Ohmai  briefly  dlSC«sscd  ' term"^ ^calibration)  or  for  20  minutes  while  the 
270K  is  observed  for  10  seconds  ( 570K  to  340K  Hong  term"  calibration).  The 

temperature  is  to  its  equilibrium  temperature  of 

blackbody  takes  approximat  y suggested  that  higher  accuracy  may  result  by 

observ in g It^d y3 state  *>M  non-equilibrium  temperature 

distributions  in  the  target. 

Carol  Johnson  reviewed  the  csUbrs.ion 

lUSlicyh* '«"Swe'»  NIST  standards.  NIST's  clients  «e  usually  government  agene.  . 


predominantly  DoD.  They  arc  provided  with  technical  support  and  applied  research 
services  according  to  a fixed  fee  schedule.  Ine  recent  years  NIST’s  mandate  has  been 
expanded  to  include  support  to  industry  in  the  development  and  commercialization  of  new 
products  and  processes.  The  Radiometric  Physics  Division  offers  standard  reference 
materials  (SRMs,  books,  radiometric  sources,  detector  packages)  and  calibration  services 
such  as  source  characterization  and  calibration,  cryogenic  ESR  detector  comparisons,  and  a 
LBIR  (low  background  infra  red)  source.  Johnson  appealed  for  more  information  on 
requirements  for  the  "round  robin"  intercomparison  program,  so  that  NIST  can  prepare  a 
suitable  proposal,  and  a discussion  ensued.  George  Aumann  said  that  the  first  step  is  to 
jdentify  the  weak  points  in  the  error  budget  for  each  instrument,  then  to  determine  "round 
robin  requirements.  Bob  Martin  asserted  that  the  first  step  was  to  establish  that  each 
manufacturer  has  control  of  its  calibration  error  budget,  while  Chris  Palmer  felt  that 
knowledge  of  the  detailed  physics  and  performance  of  the  instrument  was  key.  Guenther 
noted  that  the  objective  of  the  "round  robin*  was  to  establish  commonality  of  instrument 
data  sets,  so  that  implementation  must  be  a single  coordinated  community  effort.  This  topic 
will  be  further  discussed  at  the  Utah  State  symposium  in  September. 

^'?rr^.^*co^scn  discussed  TIR  calibration  experience  at  Utah  State.  The  group  has  20  years 
of  activity  in  sensor  calibration,  much  of  it  for  upper  atmosphere  rocket  experiments  to 
observe  the  aurora.  Three  multifunction  calibration  vacuum  chambers  (called  "MICs")  have 
been  constructed  to  calibrate  a variety  of  TIR  sensors.  The  MICs  allow  illumination  of  a 
sensor  entrance  aperture  under  a range  of  well-controlled  conditions,  and  with  selectable 
sources.  Controlled  parameters  include  source  radiance,  illuminated  area,  illuminated  solid 
angle,  and  variable  background  radiance. 

Nick  Koeff-Baker  discussed  activities  at  G.E.  Instrument’s  calibration  will  be  verified  on 
arrival  at  G.E.,  verification  being  a base  calibration  with  limited  resources  available  After 
platform  integration,  calibration  will  be  available  in  a T/V  chamber  with  a calibration 
target  that  may  be  supplied  by  the  instrument  team,  and  probably  would  be  the  one  used  for 
earlier  calibration  activities  at  the  manufacturer’s  facility. 

Y.  Yamaguchi  addressed  inflight  cross-calibration  of  ASTER/TIR  and  MODIS-N.  This  has 
the  potential  of  improving  ASTER  calibration  at  low  radiances  (brightness  temperatures  as 
A°^riSJ220K)’  Sincc  ASTER  view  space  as  a calibration  target.  Bands  11  and  14  of 

ASTER  are  close  spectral  matches  to  MODIS-N  bands  at  8.55  and  II  microns,  but  are 
mismatched  in  spatial  resolution.  Yamaguchi  suggested  that  suitable  transfer  targets  could 
be  snow/ice  fields  in  Greenland  and  Antarctica,  or  cloud  tops,  with  spectral  band  models 
used  to  correct  for  differences  in  atmospheric  transmittance.  Feasibility  calculations,  in 
particular  for  atmospheric  corrections  (including  clouds),  and  target  selection  are 
incomplete.  ’ 

- - 1 - ’X 

There  was  a discussion  of  the  Calibration  Peer  Review  process,  intended  to  provide  in-depth 
technical  reviews  of  plans  and  activities  to  the  PDR  and  CDR  meetings.  Several  questions 
remain  to  be  resolved,  such  as  who  will  select  the  review  team,  who  is  eligible  to  be  a team 
member,  definition  of  the  team  charter,  the  schedule  for  report  delivery,  and  how  to  close 
action  items  identified  by  the  team.  The  team  should  ensure  consistency  with  the  closely 
related  information  contained  in  the  Calibration  Plan.  ' 

The  draft  agenda  of  the  TIR  workshop  planned  for  Utah  State  in  September  was  discussed 
and  modifications  were  proposed  to  emphasize  cross-calibration  methodology,  results  from 
end-to-end  calibration  studies  and  in-orbit  environment  (e.g.  South  Atlantic  anomaly)  It 
was  felt  that  less  than  the  planned  emphasis  should  be  given  to  a discussion  of  data  analysis 
and  archiving.  The  meeting  adjourned  with  insufficient  time  to  address  the  last  agenda 
item,  a discussion  of  the  format  and  contents  of  the  Calibration  Handbook. 
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1.0  INTRODUCTION 
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Experiment  Overview 

U 

Validation  Criteria 

“ 

1.3 

Validation  Approach 

* Physical  constant  standards 

- Approach  to: 

• 

' identifying  internal  assumptions 
* or  .internal  consistency  / summary  statistics 

- comparisons  with  other  data  sets 

- 

2.0  DESCRIPTION  OF  EXPERIMENT  PHYSICAL  MODEL 

— 

2.1 

Measurement  Concept  and  Basic  Equations 

2.2 

Forward  Radiance  Model 

* Radiative  transfer 

- 

’ Numerical  approximations 

- Range  of  error  values 

' «feSience)0nStraintS  (C‘8'  H"C  parametcrs  summary,  plus 

2.3 

Inversion  Approach 

* Brief  description  of  basic  approach 
- Constraint  methods 

* 

- Numerical  approximations 

* Use  of  a priori  information 

m 

3.0  DESCRIPTION  OF  INSTRUMENT  CHARACTERIZATION  AND  CALIBRATION 

m 

3.1 

Accuracy  and  Stability 

stability IFC’ tCmpCraturc  cffccts*  “Oise,  scale,  and  bias  error 

- 

3.2 

Spectral  Response  and  Registrations 

- 

• 

_ 

3.3 


Spatial  Response 

-FOV 

- Off-axis  rejection 


34  Pointing 

3 5 Electronics  Response 

- Air,  plitude  and  phase 

- Crcsstalk 

3.6  Data  System  Errors 
- Gain  uncertainties 
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- Digitization  errors 
Summary  of  Uncertainties 


with  References 


error  analysis 
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- Attitude  rates 
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of  Total  Measurement  Error 


Transmission  (e.g.  altitude  interpola 
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4.6  Estimate 
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51  Instrument  investigator  Obligations 
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5.1.2  Algorithm  Test  Data  Se,  Creation  (Instrument  Simuiat.on, 
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Statistical  comparison 
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- Documentation  / Data  Format 
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Content  of  data  sets 

interface)386  distribution  (LOSDIS 


5.2 


Validation  Software  Tools 

expedhe  ioft  <?evcIo.p  t00ls  and  methods  which  win 
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EOSDIS  Toolkit  interface 
53  In  situ  Field  Campaign  Strategy 
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• Coordination  with  other  investigations 
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■ Specific  Contributions  by  IDS 
validation 


teams  that  will  aid  data 
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6.3.6  Theory  and  derived  products 

IMPLEMENTATION 

71  Detailed  Schedule  with  Milestones 
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Definitions 


a set  of  measurement.  — 

numbers  are  preferred.  cnerified  conditions,  the  relationship 

calibration.  StSemllnd  the  g “metric 

saa’S  ssa*  <srK£S 

characterization  of  an  ™ derived  data  products. 

performance  on  the  data  „ of  calibrati0„  factors  by  comparison  with  a — 

ortjit  sensor  through  an  intensive 

• - rhration  The  radiometric  calibration  of  an  m-orbtt  sensor  tnr 

ground  calibration.  tion  is  established  via  a 

field-campaign . This  can  surface  reflectance 

charactensncs  are  measured  . helicopter  OT  aircraft  sensors  am  used  to  map 

preflight  calibration.  ^caUbrarionof  asensm^m^  . ^ 

relative  calibrarion^^wt^^^^^^  phy^^rw^^t^wlric^^esublishcd  in  ratio  or 

A Anrd  of  calibration  based  upon  known  physics.  These  may 

self-calibrating.  Asm  antutn  efficient  detectors,  or  silicon 

1)  s<d£^lW  intcrnal  quantum  cfficicncy’ 

? ^ a wu  dcfined  KmpCTature  emittancc, 

2)  pdiation  0118 

“d  . oihich  a measured  amount  of  electrical  power  used 

3)  to  the  optical  heating  of  the  same  material. 

,o  heat  a given  material  is  compar  , which  the  insmiment 


3 


characterization  The  m#» 

iterval.  AmV»M..< :.  . . _ 


!S%J?  UScd  10  Pennine  its  1 
calibration  of  the  instrument) 


„ , ™y  mnerantly  affcct  the 

confidence  interval  Ani  , , “ 

mb^uiTC  1S  cxpected  which 

cross-calibration  The  n **  * 

°f  ^ 

data  product  The  final 

5S^"~S£S?^sr„“'ss 

.s^sira^SsSraS^SrSaH 

correhtiv.  measurements  <w  „ 0r  data  P"*1'*'  verifications' 

engineering  units.  Asctofdefi  ed  _ e^°IOglC^  Ctacteristic°f  an  instrument. 

^ "*  C~y  U*d  « engineer  in  a specific  fieid  , 

environmental  variables  v,  ■ t,  sPeeKic  field  to 

^SsSS^SsSaSSa^ 

measure  an  environmen  ta  1 

error.  The  difference  benveen  a raponed  value  and  its  mie  al 

relative  error,  ^eabsoiutee™  of  measure  , 

random  error.  A component  of  the  eir  t ' ™3edbythemievalueoftbemeasurand. 
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of  measurement  which,  in  the a°sy&ematic 
systematic  error.  '^aySS^or  “nknown.  This  error  is 

of  measurements  of  ^ and  their  causes  may  he 

as-bias cnor”*  ^ ^ respect  to  a functional 

functional  test.  A test  **  — ~ ^ 

[eq"  I'bratioi  Ue  characteriration  of  <he  %*£££«**■  ***  "* 

^5SS^3^J5S£,k "O"  • 1 ding  aspects  of  the 

parameters  as  fields  Earth’s  environment,  .^l^^nviromnent  and 

i ***** or  " 

senso/outpufaTa  higher  level  product  oa^^^on^e 

=r~- — mi"  — - 

ssssss£- r--5"-* 2 Z. 


, _r  /lota  [NO  9 

Snent  to  i.  ^ ^ ^ ^ -££ 

rtibraHon.  ^ on.going  fo-sta 

7agf""^ 
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measurement  assuranr 

mathematical  model,  a ma,k  . _____ 


*<w“g.  standards.  — 

^§^SS5S3sSSS?aass 

aasasjaa-^^.-.^^^- 

StnS^b4t^^n,)-  **  <°»1  angle  bcnvct„  „*  acua,  po'  • 
pointing  stabOitv  The  • • ^“Balpamtmgdlrcctta 

statistical  study  Trl?sten£y  of  measurements  maH  ■ . 

absolute  precision  M • ta‘,u“  can  yield  a 

£Te  pndsim  of  2 ZZ I tTH in  “ 45  fc  resu,t- 

ore  measurements  of 
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hanging  conditions  such  as. 


The  method  of  measurement, 

The  measuring  instrument. 
The  condition  of  us. 


The  observer. 
The  location. 
The  time- 


The  condition  of  us,  excursions  of  ambient 

Kby  dve  digitization  size  (1 DN).  10»  » 90%  of  its  final  output 

rise  time.  The  interval  n>  whtch  a sensor  m . 7%_  o{  te  hddal  output  value. 

M time.  The  interval  in  which  a sensor  decre^  J ^ ^ ^ ^ specified 
settling  time.  The  time  interval  it  takes  an  in 

r UmitS?fiKfinaI  Ue'  |he  response  of  a measuring  mstrument  divided  by  the  corresponding 
3SSSS  s’Sr  Cedmes  referred  to  as  sensing  ^ ^ ^ ^ 

spectral  calibration.  Thedeterminadonof  variauon  in  radiomemc  response  from  one 

«-*  „ bandpass  Of  a sensor  or  sensor 

center  wavelen^h;  ^ of  «-  instrument’ s response,  the 

.. th  The  range  of  spectral  input  tc ► which ‘ Uwidth  at  half  maximum  response 

SS^y  ^^nstt^se  based  on  momen.  analyses. 


stability.  The  ability  of  an  inc^ 

3 “Z  ‘h™<c,  Generaiiy 

snort- term  stability  Rtaktr..  3 

intermediate  stability  Qt-mr*, 

^ *»  * i*.  ss  sfatsrssjjiajs * 

standard  deviation  c y j 

^ - Pieter  a 

0 = 1/— 

» fl-1 

rtfmnc"? &£2SS^  fast™nent,  procedure  or 

primary  standard  a * * — - *. 

field.  l"nu? Kii^iS2?da?  *Wd>  has  the  highest  ™.,  . ' 

eahzed  from  firs,  principles,  OT  et^S^gWfc  in  a specified 

secondary  standard.  A standard  whose  value  is  fitted  h M~ 

international  standard  A standard  ^ comparison  with  a primary  standard 

ernauonaiiy  as  the  basis  for  fi>&  ^ • setve 

~-*--Wta--r-  “ - —*r  . ^ 

travelling  standard  A cfan/^  . 

ei^r*  « «*■  — a™  m„ 
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ZZ«, «.  s*s*sz2s£&  ”*“•?“  "HSIS 

twasmand  lies.  (As  of  Ihese  may  be *»““* lo«  W»  “ ntroUed 

comprises,  in  general,  y . Qf  measurements  made  und  ^ based  on 

^^3s?S®»®!sssaB! 

S,  ST.stzsSS* » -— <■* 


I/30  or  a 99%  confidence  level  is  

result 


units. 


units 


Entity 

Term 

Symbol 

Length 

meter 

m 

Mass 

kilogram 

kg 

Time 

second 

sec 

Electric  Current  j 

ampere 

A 

Thermodynamic 

Temperature 

kelvin 

K 

Amount  of  Substance 

mole 

mol 

Luminous  Intensity 

candela 

cd 
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derived  (SI)  units, 
units.  Some  derived 


system  of  base 


Entity 

Term 

1 Symbol  | 

Capacitance 

farad 

(F  | 

Inductance 

he  my 

J H j 

Electric  Charge 

coulomb 

1 C 1 

Voltage  (emf) 

volt 

(V  ( 

Electric  Field  Strength 

volt/meter 

J E | 

Resistance 

ohm 

(Q  ) 

Frequency 

hertz 

|Hz  | 

Energy(workjieat) 

joule 

(J  j 

Power 

* watt 

|W  ( 

Magnetic  flux 

weber 

Wb  1 

Magnetic  flux  density 

tesla 

| T ( 

Force 

PreMim* 

newton 

1 N j 

newton  per  square  N m'2 
meter  or  pascal  or  Pa 


derived  radiometric  units.  (Mathematical  Symbol  in  parenthesis) 


Entity 

Radiant  Energy  (Q) 

IESHB 

Radiant  Flux  (<X>) 

watt 

W 

Radiant  Flux  Density 
at  a surface 
Radiant  Exitance  (M) 
Inradiance  (E) 

watt  per  square 
meter 

Wm'2 

Radiant  Intensity  (I) 

watt  per  steradian 

mml 

10 


Radiance 


Reflectance  = Of/^i  ■ (p) 


Emis  ;ivity= 

M/1  ^blackbody  * 
Absorptance  = 
Transmittance 


watt  per  steradiart 
and  square  meter 


unitless 


unitless 

unitless 

unitless 


where  <MVM>a  - indent,  reflect,  wW  and  absorbed  flux  respectively. 

SI  prefixes.  Used  as  prefixes  in  combination  with  the  terms  and  symbols  of  SI  units  to  form 
decimal  multiples  an  submultiples  of  those  units. 


Factor 

Prefix 

Symbol 

Factor 

Prefix 

Symbol 

iPr' 

exa 

E 

10*1 

deci 

d 

1015 

peta 

P 

lO*2 

centi 

c 

1012 

tera 

T 

10-3 

milli 

m 

109 

giga 

G 

10"6 

micro 

p 

106 

mega 

M 

10-9 

nano 

n 

lo3 

kilo 

k 

10‘12 

pico 

p 

102 

hecto 

h 

10*15 

femto 

f 

10l 

deca 

da 

l0-!8 

alto 

a 

verification.  Tests  and  .analyses t to  be ^SStavl’ bSn  iSf 

done  at  the  functional  level.  See  integrator  verification 


tests. 
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intOTadon3!  Organitadon  for  Standaidfcation  09821  Units,  u 

Handbook  2.  Geneva,  Switzerland  * 82'‘  Umts  °f  Measwement,  ISO  Standards 
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Definitions  in  use  by  the  Visible  and  Near-lnfraied  and  Thermal  Working  Groups 
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Subj^cLCCross-calibration  survey  (VISNIR) 
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Attached  bets  is  a summery  2*3^ S£d»»3Sj 

^“of  Km  groupflO  two  * 

fields-of-view  of  the  various  msmmenK,  and  3)lj_  t£pmxs.  The  group  would  like  to 

Sfl  X' o^Son  Sore  tatog  any  tether  actions. 

TTw  Crv,-.-C«;r.d.n  u™  Vdli  7am  ramlm.  (A. 

assTss*-1" 


Carol  Bruegge 
JPL  MS  183-301 
(818)354-4956 
FAX  (818)393-4445 
NASAMAIL:  CBRUEGGE 


CjCoc&t 


Cc:  Bob  Nortrup 


Instrumentor  Cross-Calibration  Goal 

°fd-  - «- 

use  ‘f  “surin?  the  primary  data  products,  are  of  known  accuracy  is  to 

independent 

«n.iwfef?!?  th*n  of  ?c  radiometric  "Cross-Calibration"  at  the  integrator  facility  rnn 
that,  whpn  est?hlish  as  late  as  feasible  in  the  Integration  and  Test  (I&T)  cycle 

properties  of  tLe  test  set-up  ftsetf.  addlI!0”ai  dneertamty  associated  with  the  unique 


CaIih™^n»;V,  . instruments,  it  should  be  part  of  the  "Cross- 

tatoSSpbdfo  'S  ^ f shfId  n0‘  **  dteplan’s  intention  that 

Sibratiom  U S Caiibranon  at  GE  replace  the  previous  instrument  radiometric 

not  in^^aCTe^enTafter  himrh  mTst^ment  t0  rastrument  agreement  before  launch  does 

sassS 


Wavelength  Comparison 

(VlSNTR) 


Wavelength  Comparison 
(VIS) 
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Field-of-view  Comparison 
(VISN1R) 
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Survey  responses 

1.  AIRS 

Radiometric  calibration:  1-2% 

Entrance  aperture:  12.5  x 12.5  cm 
JFQV:  ljo 


I 

mm 

TOO 

■H 

H II 

1.04 

40 

2.  ASTER 

Radiometric  calibration:  4%  VNIR  & SWIR 

mw  ? 7,6  01X1 VNIR^ 17  SWIR 

Nobs;  A,  4940  SWIR 


3.  CERES 

Radiometric  calibration:  1%  (shortwave);  0.5%  (total) 
Entrance  aperture:  <0.15  cm 

Notes:  Attestor  only  ambient  tests  are  planned 


Wavelength 

(pm) 

0.3  to  5 
T5Tto2ftT 


4.  EOSP 

Radiometric  calibration:  5%;  Goal:  3% 

Entrance  aperture:  6.5  cm 

IFOV:  0.81°  (3°  needed  for  calibration  as  scans) 


Wav. 

(pm) 

Bandpass  | 
(nm)  1 

Wav. 

(pm) 

Bandpass 

(nm) 

0.410 

30 

0.880 

20 

Th470 

20 

15355 

20 

15355 

20 

TB5 

60 

T53B 

15 

1.600 

60 

_0.675 

U5 

2.056 

1(50 

"5775^ 

15 

2.256“ ~ 

100 

7.  MODIS-T 

Radiometric  calibration:  5%  (relative  to  NIST) 
Entrance  aperture:  3.4  cm 
IFOV:  0.0894° 


F,H  - 33  cm/(aperture+2  50  cm 
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MODIS/MCST  Calibration  Status  Report 
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I Introduction  - ~ ' ' - - 

1 • 1 MCST  Cahbration/Chaiacterization  Plan  Objectives 

P|MS  and  related  information  fOT  re. 

preference  in  the  MCST  documentation.  TTiese pK^te **'>*  fatfSS 

tt  i committee,  and  will  be  included  in  the  MODIS  calihrarin  ?wcd  toe  M^OJSxalibration 
Updated  versions  of  MC STs  Calihratirm/rnT  MU  . calibration  plans  to  be  dehwritd^En^nTQ 

totes  of  the  MODIS  ScSSSS”*'™"'  "“»*“•'*>  *»«l  *££&%& 

science”  datausen  who^S^'S^emd^f"00  •the  M0DIS  for  the  many 

document  is  intended  to  provide  a thorough  “?  c#ration  information.  This 

radiometnc  calibration,  spectral  characterization  the  pJapKbt^jre-Iaunch  and  in-orbit 

instrument.  References  to  other  published  lfreram  Md  gC0Ipetnc  ttoibacterizarion  of  the  MODIS 
acronyms  follows  the  technical  serrionc  are  included  when^possible.  A list  of  helnfiii 

rfvhZatiQJi  and  related  organizations  and  rest>onsihn>tlVC  inforPati<^  including  schedule 
Calibranon  Management  Plan.  ^ nsi  Cities,  may  be  obtained  in  the  MODIS 

1.2  Document  Overview 

* MCST  «^^lao  Objectives  and  provides  an 

compared to™JESsfe^i^S°'  Plans-  MODIS  instruments  will  be 
coverage.  These  comparisons  will  enhtmSS? rli V ^ ““P^We  fwlds-of-view  and  spectral 
MODrsT1'"8  Dt  instrum'nl  penbrmance.  Other^sMsore  OTd  prc!"dc  a more  thorough 

iod  the  toS“S4^r.S' ASTCR>  E°SP- MSR  “1  rte ISsHatfS^' 

u5d“S£fg^' fr0m  !«*«<*  » in-orbit 

tt:  sautes 

between  pre-launch  and  in-o m sares , * mu,sfer  ““*■*&»«  and  ch^cS“s 

based  methods,  including  the  use  of  ground  tareers  and^C  ca  ibrators  noted  in  Chapter  4;  target- 

asr- “ “*  »***& 

Chapter  6 contains  infotmation  on  in-oroit  geometric  characterization. 

Chapter  7 describes  in-orbit  spectral  chractenzanon. 
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► the  topics 


continually  rcnnco  <» 

-g^gggi^spsB^ 

definition! 


the  calibration  wm  ^ 

H-finirions  and  references  app  P 
Chapter  10  includes  a list  of  acronyms,  definitions,  an 

considered. 

1 .3  Applicable  Documents 

Documents  penmen,  to  this  one  include,  but  arenotl““d  Jr  GSFC  42<H> 

(1)  Eanh  Observing  System  (EOS)  Project  Calibration  ^ 

(2)  |2*  Observing  System  (EOS)  Pmjec.  Conftgunmon  Moment 

n\  1990  Reference  Handbook,  EOS; 

S{  MOT  Interface  Control  Document; 

(51  MODIS  Calibration  Plan; 

6 MODIS  Verification  Plan; 

(71  MODIS  Calibranon DataBoo^ 

(8)  MODIS  Calibration  Handbook. 

1-4  Overview  of  Instrument  Design  Itvicws  the  Earth  from  an  orbit 

MODIS-N  is  an  imaging  scamf^S^^_  +°5o  ^ instrument  measures  the  at- 
Of  705  tan.  and  continually  scans  <^J|"^85  'm,  m footprint  of  dte  detectors  varies 
satellite  radiance  in  36  bands  from  -40j«”  ^ (29  bands). 

from  0.25  km.  (2  bands)  to  0.5  tan.  (5  ba|g  Radiatk,n  from 

’ The  spectro-radiometer  itself  is  a 2^to. foe  lifht  onto  four  focal 


1 s <hin£le  Official  CaliSanon  Algorithm 

^ -0  , , xyror^T^  ccicnoc  team,  to  select 

i 


! 6 Mulnple  Parallel  Approaches 
In  order  to  have  confidence  mat  the = requimd  '? " t 
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ate^UTO^^rap'S^“1.Sof  Sm  SrilfSd!”''  baSKi “i'th?ds  ^b  on-ground and 
TOMS,  a "calibration  tableThich  cM  S ,,Srf  ,„P!  pathways  is  to  obtain,  through  inri.^T-. 

basts  (the  MODK/MCST  calibradon  al^titim)  insttumcnt  ON’S  to  radiance  on  a routine 

1-7  Mathematical  Model  Development 

instrument  to^ow^^mSe^rci^o'™^’  *?  mainain  a mathematicala^odel  of  the 
studies,  and  degradEnKra ^SysS^  5££* 

be  produced  to  document  analyses  and  the 


Comprehensive  Documentation  Trail 
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2 Pre-Launch  Calibration/Characteriiation  Methodologies 
2 . 1 Objectives/Rationale 

Prior  to  launch,  the  MODIS  “s^in^^^‘^°i^^SConK)rbit  res^  to  obtain  a 
calibrations.  These  pre-flight  v 0yCT  time.  In  addition,  the  instrumen^all  be  well- 
measure  of  performance  of  the  MODIS  hnt  not  limited  to,  lineanty^^wl"to-noisc 

Seized  before  launch  McSdXransfer 

ratio,  coherent  noise,  scan  modulation,  andbW  Spectral  band  shapes  and&ut-of- 

Function  (MTF)  will  be  measured  nse  time  and  overshoot  or 

band  responses  will  be  measured,  pie  tran  sp  ^ measured.  The  spectral  band 

undershoot,  will  be  t.este^  ^11  be  measured.  Most  of  these  testf  wiU  be  performed 

registration  along-track  and  ®cnwj-mc^  A ^ cf  29  different  tyojes  of  characterization  tests 
under  both  ambient  and  vacuum  conditions,  a toiai  oi  **  ^ v*r. 

are  planned.  , 

, xyinriTC  onH  all  EOS-A  platform  instruments  will  oe 

As  pan  of  EOS  calibrauon  planning,  M(®IS  awdi 7 ^eUngstandard  radiometer.  These 

Information  in  this  section  comes  SSS&SgSg 

this. doonmentiffe^mw  by  members  of  the  MOST. 
Additional  information  is  provided  by  MOST. 

2.2  Radiometric 

be 

for  the  thermal  bands,  this  requirements  1|b$^ 

2.2.1  Absolute  Calibranon 


Source-based  calibration  techniques.  wuh jsources  StiU 

used to  perform  of  ^^^S^SSKdyVai  be  used  for  the 

used  for  the  VIS.  NIR.  andSWTR  bands,  i ana a _iuu  ap  ^ m ^ a funcnon  of  input 

consrituies  dteir  precision,  while  the  dev.at.on  of 

SS.  tan  a’m.ei^f  calibration  accuracy. 

2.2.2  Relative  Calibranon 

The  preflight  absolute  calibration MODK^^e  first  toedon  of 

history.  Subsequent  calibranOTS  vn  documented.  Relative  comparisons  are  also 

t0  or  companng  * outputs  0 

dffferem  detectors  within  a band. 

n 3 Geometric  Characterization 

JrrsassKS^^ 
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will  be  made,  but  a pointing  knowledge  of  30  arc  seconds  and  alignment  changes  of  60  arc 
seconds  will  reduce  the  overall  pointing  knowledge  to  0.5  pixels. 

2.4  Spectral  Characterization 


Preflight  spectral  Characterization  of  the  MODIS  instrument  will  based  on  relative  spectral 
response  measurements  made  with  a grating  monochromator  coupled  to  the  MODIS  calibrator 

mto15  dcvSe  Bac*?Ne  10  NIST  sUicon  photodiode  reference  debtors  for  the 

nSjgLjgjgly  Naval  0ce“  Systcms  Cen“r  (N0SC>  for  or 

3 Instrument  Cross*Calibration 

3.1  Pre-Launch  Cross-Calibration 

3.1.1  Cross-Calibration  Among  MODIS  Instruments 

3.1.2  Cross-Calibration  Between  MODIS  and  Other  Instruments* 


• .u  ^^DIS  shall  be  inter-compared  after  integration  with  all  other  Optical  instruments  operating 

spcctnu.ref10ns  <e-S-  ASTER,  MISR,  AIRS,  SeaWiFS,  and*  with  HIRIS  fffi 

SSm  g 3 S1?,glf  ^^.A  cross-calibration  between  MODIS  sensors  and  the  Landsat 
Thcmanc  Mapper  will  also  be  performed. 


'hilJS later  et  al..  University  of 
>na;  Doug  Hoyt,  RDC 


3.2  In-Orbit  Cross-Calibration 
3.2.1  Cross-Sensor/Within  Platform 

Introduction 

Several  passive  remote  sensors  using  visible  radiation'  arc  planned  for  the  EOS— A Dlatfnrm 
Each  instrument  will  be  independently  calibrated.  After  collections  for  differences  in  footprint 
size,  spectral  resolution,  and  pointspread  functions  are  made,  the  radiances  measured  by  the 

whether  10  Wlthin  thcir  st^§ccuradcs-  u do  agree,  it  tells  us  that  any  biases, 

whether  the  bias  is  zero  or  not.  are; the  Jggfc,  If  they  do  not  agree,  an  opportunity  exists  to 

confid/nre  thC  reaS unS  fof,  the  disagrecriients:  The  more  instruments  that  agree,  the  more 
confidence  we  can i have ; that  correct'  measurements  are  being  made.  Potential  comparison 
instrument  include  MODIS  (am)  to  MODlS^pm),  AIRS,  ASTER,  EOSP,  and  MISR.  sT^ of 
these  potential  configurations  arc  discussed  below. 

Visiwfrf J«nT2ne2CmI'55TOi  Sound,er>  has  2 56  km-  footprint  with  five  channels  in  the 
i°‘ uS<  AIf?^~comPanson  t0  MODIS-N  will  consist  combining 
many  MODISpixels.i^eightedfiy  the  AIRS  pointspread  function,  to  form  an  image  like  a single 

AIRS  pixel.  Because  MODIS^N  also  appears  to  have  better  spectral  resolution  in  the  visible 
several  appropriately  wetghtal  MODIS-N  bands  will  be  required  to  match  the  AIRS  resolution* 

f SJSf1  w"  J11^  hun,afds  of  AIR?  Pixelswuh  MODIS-N  simulated  AIRS  pixelTshould  give 
a reasonable  indication  of  the  amount  of  agreement  ^ 

r n M?D.IS~N  dso  ma)cc  infrared  measurements  which  allow  comparisons 

° be  rPadc*  A : each  thermal  wavelength,  contributions  are  coming  from  all  layers  of  the 
atmosphere  and  the  surface  usually  expressed  through  atmospheric  weighting  functions*  U the  two 

dh  001  haVC  slrmJarJ^ndPasfes'  comparison  is  made  difficult  since  the  same  layers 
of  the  atmosphere  are  not  sampled  equally.  It  is  likely  that  radiances  in  the  thermal  bands  for  these 
two  instruments  will  not  be  compared  directly,  but  a derived  geophysical  parameter  suchassea 
surtace  temperature  will  be  used  for  the  inter-comparison.  The  thermal  cross-calibration  technique 
for  this  pair  of  instruments  and  for  other  pairs  of  instruments  is  a topic  requiring  further  study 
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. • oefiectionl  has  a 30  meter  nadir 

EOSP  (Earth  Observing  Scamiitgjojy™^^^0 ^^^icing the 

functions,  to  match  the  EOSP  radiance  observations.  ^ ^ ^ ^ be 

MISR  (Multi-angle i Imaging  s(f*,S«^SSSg angles  cannot  be  mamhedby  MODI^N. 

££«£ *-  • ta  inBr' 
compared. 


Approach 
One  method  for  the 


une  cross-ealitocmof  respea  to  mi  t 

EoJJiSM 

Vp'U“U  •:•:#* 

^2],  ,<sk  jm"wm 


Results 


its  reflectance-  based  method  and  ?W^e^^S^thld  which  uses  measurements  of  the 
also  developed  a reiineme%Jo  us  reiictum 
diffuse  and  total  irradiate  atddtsurtace  [4], 

5 “d  15  percem  in 

The  University  of  S 

and  follow-on  sensors  and  a MODIS  simuiat  t r a solar  radiometer  designed  to 

“methods  to  include  the  use  otafteld^WIR  gSmeier  which  will  be  used  to  study  the 
measure  total  column  water  v^r  and  "S^tor  Qf  aerosol  scattering  and  the  group  hopes 

“5£i 
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K's^r” radion,e,ric  I#™  °f  *■ 

sensoii"^'iGA^SMRVoi’.  fJ^S]^jil^i«^^ai*,,^b*^  “libra^S^^agiag 
3.2.2  Goss-Platform/Among  Sensors 

imaging  sensorby^ referenSm  ftoghe?^  IOW  spatiaI  resoIution 

funded  under  a NASA  grant  and  isoneoTne  The  AVTOR^  TTiis  work  has  been 

satellites  have  been  calibrated  whh  reXSS  m ^C^VHRR  senson  onlihe  NOAA  9,  10,  and  1 1 

d'Observation  de  la  Terre  (SPOT)  HRV  cameras  Thet^^h  Systeme Probatoire 

reference  to  a ground  site  such  as  White  SancbNe^M«S» ^H001 ^ens.or  * calibrated  with 
using  a ground  reflectance-based  method  Pixels  ZJ/S  c.abbra£lon  « normally  done 
nearly  coincident  with  the  low  resolution  im,«\  from  ? {?Sb  resolution  calibrated  image  (taken 
the  spatial  resolution  of  the  AVHRR  image § “* ag^regatcd ® 
differences  and  for  the  ground  target  bidirecdonal  *iIJior  spectral  resP<>nse 

geometries  are  significantly  different.  The  ground  refl^SS^i®1^  *c  sensor  acquisition 
high  resolution  image  [3]  Soatiallv  uniform^^ac  cc^hce  is  determined  from  the  calibrated 
used  in  a reflectance-lM^^ertodUnj^dete^^«<rh^ ofmuidP1' low  "“'“bon  pixels  m 
atmospheric  correction  is  of  Ute  AVHRR  senior.  The 

ground  at  the  target  site  during  the  high  resolution  gfv]SipropCrtles  measured  *»  *c 


References 


Jackson,  and  M.S.  Moran.  SiR  B,g8ar>  Rp-  Santer,  RJ5 

Proc.  SP1E,  Vol.  924  Recent  Advance  £ ?“onK"c  calibration  of  the  NOAA  AVHRR  sensors 
Sensing.  196-207  “C“  “ Scnsors'  R“bomeBy,  and  Data  Processing  RemoTe 


3.2.3 
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to  1100  nm)  ^avTTsu^fy^^IrSf  ,q^,c  md  near infrared  (visnir)  spectrum  0400 

Advanced  Very  High  Resofution  Ra^ometef  (A VHW  tSif SiiSi  h 10  °?iL  F°r  cxamPle> 
ranging  trom  7%  per  year  (NOAA-9)  [1]  to  nearly  zero  (n“! SaoSSSSSS 
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i~iniri  at  shorter  wavelengths  (average 
„ after  launch  indicate  that  degradation  is  ^ less  than  1%  per  annum  for 

orb^0rB^^C^^s^a^S°®  lat^hJ^estLahsh^he  ga^ 

a ssssassss--.  ■ JL~~ 

* j: /*oi;Kr?irion  svstem  for  the  visnir  


Lnc  awui^j  i , 

MODIS  will  have  an  onboard  ^“c'„ ^^“^S^objective  is  the 

^^^B&ss^sgss^ 

Ficure  3 3 1 illustrates  the  method,  which  J^“s“^c^j£Kd^^OTdiomeKr  on  the 
do5S£  ground  target  as  a ^“^&t|i  on  aerate  Paction  of  the 

• r. a »ht»  radiometer  on  the  satellite,  me  r aircraft  soectroradiometer  to  oe 


clo^e^d-g^r^«" 

• . ft  nnfi  the  radiometer  on  the  satellite,  me  ^e  aircraft  spectroradiometer  to  oe 

SKeMgsESisSSftfgS 

augmented  in  the  case  of  AVHRK,  tor  ex™p|*j  > . squares  fit  between  the  sets  gives  inc 

of  the  best-fit  line. 


LOWTRAN-7  [3]  computer  code.  The  aircraft sp  ^ cncoinpassing  the  spatial  ^gcofthe 

Version  1 13  Apnl  VM- 
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amform  targets  (such  as  dear  ocean  surfi?e)  SSStata  fe***  . ^0me“X  0ver  eff«^e|y 

have  not  changes* since' being measmSdbefore ' lauiS^d  aSf  t'  radion,eIer  channels 

orbit  are  attributed  to  changes  in  gain.  For  NOAA-1 1 AVHRR0^6™'?  cbanges }Me5P0ttsc  in 
here  show  that  the  gain  ratio  of  channel  1 rn  ruft  1 1 £ Y™*  ?c  Preliminary  repts  reported 
October,  1990,  is  const  ™o  wiSb  ! % nF'l?  d™g  **  Pcriod  No^effer,  I988to 
changes  its  spectral  response  duringSis  peL^d.  ^ g y SUggCSts  **■“  nci^^toel  h£ 

NA?A/r  ?ment  was  ac^u^nf,OTNO$^Un  00  “ ^5^  schedule 

NASA/GSFC  laboratory  at  Greenbelt  MD  before  »n h If,  g‘  ^5. ?ystcm  wa$  calibrated  in  a 
between  flight  and  calibration  usuaSy  exceS^l  f fr!£0Kst  but  Lhe  ^ intervals 

ambient  laboratoiy  conditions  and^thout rie^ft  cahbl^n^a  we-c  collected  under 

as  a function  of  incidence  angle  was  measure  srnararA|d0W  !T  ? w^dow  transmittance 

correction  term.  g Was  measurc  separately,  and  includedJn  the  calculations^ 


L22mdiamet«-  hermspherewhtot^  t0  radiance-calibrate  the 

standard  lamp  supplied  by  Optronic  Uboratories^n^SiJSS^6  SpJStrum  ofa  secondary 
spectroradiometer  equipped  vtith  a small He !"2? t0  “ °Ptronic  modcl  740A 
integrating  sphere  is  to  render  the  740A's  Ue  P^^e  of  the 

^ST'  °f  * dU“ettrS  0f  the  aP"™«  “ 

embedded  in  a “/?  * bari“m  “■*“*  pigment 

amps  is  baffled  by  a lariuKS^edYS^v«Sit“  ^ ^ 

illumination  of  the  exit  aperture,  and  the  tlalintemal  face  ofihM^  e<rnon . 11131  prevents  direct 
The  lamps  are  independently  switchable  and  are  mn  a Q °^tbe  hemisphere  is  painted  matt  black, 
for  the  uniformity,  accuracy  and  stahiiirv  nf  »u  C ^ at  a CUITCnt  of  6.500  ± 0.001  amps  Results 
published  elsewhere  [^^^ni^rmity  of ^Lh^ ra^ancl^dd  fw^°?M^idlC^endsP^™) 

SS  * p0sid01’  “^onglilS/^h^" 

directed  ^'^^iIh"?1,0*s  ><*  optal  axis  to  be 

by  an  onboard  minicomputer  through  azimuth  and  e?^^^rf^S'  Thesc  mon°ns  are  controlled 
accuracy  of  approximately  l<>.  The  opticas  T ? ^ motors  ^ 3 Positioning 

inflasil  window  (both  have  been  used)  setlnto  the  flSrf*e  5te^ft",Cr0f  “ “”“atcd  <!““*  or 

]J&*t£S2£-. S hen”SSfly  ^ behind  its 
dependent,  so  the  detector  temperatL  is  aedvefv ^in£?,aily  1000  nm  « temperature 

heat  exchanger.  Heating  pads  ate  wound  a3  fte  tod^of  17Cwitha  Pelder 

internal  temperature  gradients.  Under  flight  condirion^he  .l^  sPec'mradtometer  to  minimize 
measured  close  to  the  specuoradiometer  X ^ of  thc  apporting  frame 
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i «*4rtn  nf  the  second  blocking  filter  and  the 

elevation.  The  which  has  its  own  dedicated  cloct  m 

Inertial  Naviganon  System  UNaJ.  *»“  . ML  r^nc 

r #Vvr  r^c^nt  tUC&Sl 


Inertial  Navigation  System  (IMa).  «nKn 

Whi*  Sands,  NM.  has  been  .he  urge. of  choice  ta "£“32 « V ' 
evaluation  as  suitable  targets. 


ature 


151  obtained  for  the  NOAaWvHRR  from  6 ER-2 


his  over  White  Sanaa,  rtm, TlWhod  no*  available 

area™  b^^ed'at^nnu^ 

^^:sr»ss« 

1992. 


:r^% 

&gfercnc£S.N  « 


HI  Srntth  M measurements,  7.  Armor,  a 
"^IVSu  andG.R.Smith,19S5n  Aircraft  measurements  for  calibration  of  an 

Kfetsensor  AM 

m Kneizvs,  F.X.,  EJ’-^ncnw,  i-  r.uide  to  1 QWTRAN:!.  Air  rorwc 

Metrologia. 

[5]  Published  data: 
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calibrations  of  the  NOAA-U^VHRR'nSS’h”^ '^V ••“  S-B-  Biggar,  1991.  Results  of 
Sands.  N.M.,  SPIE,  1493.  182  $?*  °”de  by  refOTn« 10  ‘•“‘“ted  »OT  imaged  WtiB 

As  yet  unpublished  data:  - 

channel^j>axi^fiOTi^of^Mta^raft*otewratioi«^i^^Ma^^JtS  for  N0AAi‘  AVHRR 
atmospheric  saatt^g^^  (k  "dbl'  "d  & 

Kaufman,  Y.  and  B.  Holben,  personal  communication. 

4 TCa!lbfmo0raCa'itrati0n  between  P«’L“"“>  <o  In-Orbi 
4. 1 Objectives/Rationale 

caUtaSTifc calibration^ and  the  firs,  in-flight 

MCJDIS  instrument  to  rid L brid^TS?  t,  cahb^  .^ve  been  desi^ 

calitoators,  mciuding  a solar  diffuser  and  SpectSratbom^^Ar^’^f ht  calibratio“s-  These 

»‘a£rgagf»tfras 

environment.  cnange  calibration  after  insertion  into  the  space 


|fcg  On-Board 


4.2  Radiometric  Calibration 


(?BO  - * ca‘thnted  pra- 

^wratine  die  diffuser's  response  a^a'functiM  ^'^ntxien^^a^^tgie^f^chtence'wiu'also  ^ 


4.3 

4.4 
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f 7.  ■ * * ’V 


5 in-Orbit  Radiometric  Calibration  /Cbaracterimtion 

5.!  Objectives/Rationale  assessing  the  perfomance  of  the 

^smimcnt  operation.  M^ncrm”^311* 

5.2  Instrument  Based  Calibration 

September,  1991. 

The  MODIS 

of  the  MODIS  thermal  bands.  ^ 


5 2 1 Internal  sources/assembUes 

«... 

instrument 

5.2.1.2  Blackbody  , f in-flight  calibration.  The 

MWIR  and 

^ 

The  blackbody  cavtty  deagnts  stmar^^ 
plate  with  V-grooves  cut  at  25-degree  I 1 

The  solar  diffuser  s^b^ch^Cs.  The  optical  system  f.^Htdettctor.  The  fore-opnes  can 

eS^SESSSSSssaar— “ 

within  two  orders  ot  magmiuu^ 


5.2.2  External  solar 


5.2.3 


External  lunar 
y^^rduction 


H.H.  Kieffer  and  R.L.  Wildey,  U.S.  Geological  Survey, 
Flagstaff,  AZ  86001 


Induction  . r^iihration  subsystems 

In-flight  me  endre  opdeal  sysram. 

themselves  are  subje  Version  1 13  April  1992 

9:46  AM  4/1/92 
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S^ujneous  measurements,  . substantial  ground  campaigned  ."M£SES!S 


to  P7vidc  n.ew  radiometric  information  needed  to  allow  the 

s*  ,izs^t£ir  usc  of  * moon  to — * or  the" 


moon 
ents 
knowledge 
' scattered 


Background 


instil “i!  C«  d>Ta™c  «>ge  of  most  imaging 

brightness  distributes  be  VaertaL™ tL^ha,  W f “ ‘8*™?  band-  “*» ia  smtra 
insmtmen.  can  be  safeiy  poinied.  A.thou^  SS 

intnnsicaDy  constant  over  long  time  scales  (natural  rate  of  change  e«rimll!w?i  rv9  ^ 10  ^ 

libration  pnmanly  to  the  lunar  photometric  function  and  the  lunar 


“Tl*  P°ms  of  *0  sub-earth 


S3^fntei«S».  P~  '0  y«d 


nonuniformity  in  the 


both  latitude  and  longitude  both  with 7ZJ ° Yr1  3 vanation  of  abouI  ±7°  in 
require  the  dual  processional  cycle  of  18^5  Vrar«  /■qJvt°n?moath’  ^ut  wdl  smad  differences  that 
Saros  cycle)  to  complete  (accldtn,J>'  approximately  the  same  length  as  the 

mod“S^^  Quantitatively,  a, 

value  near  12.5%  [2].  Albedo^S%L^  ™ f*  9*  t0  2 ^ with  a mean 

resolution.  The  moon  appears  gray  ^the  Visible  hml^  a l°!/eS  .^  °W  thc  limit  of  telescopic 
near  infrared  [3].  VariKESS  *“  a &eneral  “crease  in  reflectivity  into  The 

spectral  features  that  do  exist  are  relatively  broad  [4,5]  00300115  °n  ±C  moon  is  smaU*  ^ ^ose 

obse^r^re)d^o™|&e  .“e“bnteSSr-  ,i"S  ?•'  Pha“  “*  ^™n- 

effect"  [6],  which  in«SS  called  the  "opposition 

lunar  photometric  function  islnited  to  a fet  wa^Te^c  a^";  fCurrcnt  knowledge  of  the 
spauaily-integrated  lunar  tightness  (the  phase  function)  [%]  d ^ $maU  **“*  °r  for  the 

radioS^  *“ a 

£!££ - 'rir  — 

HHUS  spadal  resolution,  typically  have  /olatiaatii  a.  p^g^^SS 

“ *«  1 <“»  W ^ 

areas,  and  leas,  for  bright  areas  [6],  Variations  ^th  S 
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^ ^ w0*  indicated  that  near  full  moon,  polarizanon  .ear  the  limb  of  to  «—  - 

about  0.1-b.2%  parallel  to  the  limb  IW  ^ thermal  emission  becomes 

Because  the  surface  of  the  moon  can  ^ome  as  hot  a^  • ^ ^ w%  . U put 

^jssssrss t—— — 1 

&E823&  • i:m;ted  to  attempts  to  calibrate  the  absolute 

Current  knowledge  of to 

Jiiometric  observations  w,m_^u^/r^«05blM^sparency  of  the  earths 


tew  wavawisu-  *.  *■  , ohservanons  win  uc 

HKIS,  extensive  -The  wavelengths  of  q t^aam 

passbands  by  use  of  interference  filters,  ^ ^ onc  to  VNUL 

Son™ shonld  be  polanzanon-insensm^  „ cm  ^ Be  used. 

For  wavelengths  frtmn0^o^*®j^ip^^^^1^^»^^esn^iable^wavel«t^toto^^ 

An  in*dotne  radiomeoic 

astronomical  observances  each  mg»  ™ large  enough  to  i “?£T“Eo!  rJnable  radiometer 

^\srS^S^s^“sas^““  . 

standard  (Phil  Slater  p comou'  er  control.  Most  of 

The  telescope 

^SSi  variation  of  appareut  radiance  due  to 

amospheric  lensing  (scintillaaon).  observations  are 

0bTbservadons  will  be  ^«"Sc"^ 

weeks  of  each  lunanon)  on  all  photom  , „ April 1.992 

9:46  AM  4/1/92 
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m^ia^acaS?re!tolu^^^  ordcr  to  develop  a photometric 

c^^veten^b^UCCd  10  PrDdUCC  a Ph«S  of^hpuZ  in'Sifp^jS^ 

radiance3--!!^^.  h^e^a^Mt^conShn^  ®xpccted  Iong*tenn  precision  is  ~0  8%, 
calibration  of  the  s^daSkSp  bUU°n  t0  of  absolute  radionSrp 

KSSSrf  W m^nTi^^dl' ^m°0,l  “ 1 <o  a 

5, 212, 25 J and  6.4  pixels  across  the  moon,  respectively.  ^ and  1 ^ resolution  would  have 


ad  absolute 
cy  is  the 


ation  observations  of 
' in  the  dynamic  range 
niglc  greater  than  1.5°, 
Tiglc  of  less  than  about 


ftc  ™on  should  be  made  at  small  phase  an^if m Z*bt  ° 

where  SShpre  ^ ™le  31  “p  P® 

6°  «*  month,  £ ESS5?*?  m°°n  ““  8 "“»» * 

Expeaeri 

be  used  to  ( Sculate^^^  observation  geometry  will 

wavelength.  This  radiometric  image  will  then  be  ceom^^^n^^0^  sPatiai  resolution  in  each 
“1°?' “gjon  of  the  spacecraft  instrument  imair?T^^tf?nSforms.to  *““*  the  resolution 
pecific  HIRIS  observation  increases  the  overall  raei-  Spatial  uncertainty  in  resampling  to  a 
would  be  similar  for  pixels  K ^ "*SEa 

produce  a radiometric  image  based  on  S«Si£j£?3r 2Je  “am  for  that  instrament  would 
the  factor  between  die  twolaiitoS^ P|f™0n  “*  rano  o(  **  «™  images  re^„* 

for  h°f  ins™m=ntai  scans  across  the  moon 

resolution  and  radiometric  precision  of  dtisMdy'would  t^dy  fce^terfed^  purpos's  Ihe  spanai 

***»'  15%  uncertainty,  are  now 

References  j 

fl]  Kieffer,  H.H.  and  R^SiSiifdev  1985  n..!, , ,., 

&r,^'  W.  SuSfiSZT  °fUndSaI  using  the 
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. _uj.ec  curves  and  albedos  for  the  lunar 
, . . t -n.  1073.  Monochromatic  phase  curv 

Ssk! ^on^jTur,  78>  267-OT^  ^ photometric  properties  of  lunar  terrain  derived  from 
rQl  DoUfus,  A.,  lvoi.  rvi< 

and  B.M.  ^<^^^Annu^s  Observatoire  Meudon,  voL  8,  part  • ^ Qiarar***^^  of Jh& 

[101  Lyot.  B,  1929;  Smal  moon:  a review-  ta 'ffBK  3-497 


5.3  Target-Based  Calibration 

5.3.!  Target  relaied/ground  reflectance  hIesMCtnlrefle«ance  over  many 

>ptical  depths.  A radiau  C£  at  ^e  entrance  pt^^of  the  . , corresponding  to  those 

jsed  to  predict  the  m-ba  average  digital  countstpf  the  p been  applied  to 

*adiance  is  used  along  [1. 21.  TJ*  »« £!?£?  EG&G  ht  Sth  a jet 

3SS."  n"  SS  " " -S““SS£.“.£  £»“ 


Unmodified  approach,  provtcg^^--  ^ , of  hi  eh  spatial  resolution 

mm*  ‘s^»s»“  Ssaiiras 

method  similar  r°us^  d follow.on  sensors  and  a MC^ISfild  sWIR  spectrometer,  a solar 

sai^Sts;“sssi.-  - - — 

the  group  hopes  to  impro,  ^ 
instrument. 

Reference  . nYMao  M.s.  Moran,  J.M.  Pahner, 

m Slater.  ^ for  the  m-fllgh.  absolute  caltOraoon 

andB.  Yuan,  198  . z?^m  Sens  p/ Environ.,  *-2, 1 1 3 • iqq^  Absolute  Oilibrnuon  of 
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£d  Sltoi Ri98SG,FluJ'S'wMaI'g0liS’  C BrucW-  0A-  Vane-  R E-  Alley,  PN  Shier 

* ' **' **"*  “ 

5.3.2  Bio-optical  oceans 

nm  at  wavelenghs  greater  than  about  700 

accurate  radiative  transfer  model  allows  the  nth  r^H*-^riSin^  cntirely^^rom  the  path  radiance.  An 

provides  a known  source  which  allows  MODIS  to  be^alibrarStSraif*!  h^S  Z*811** 
instrument  calibration  and  the  radiative  transfer  model  self^S^?  <'“  maic“  (he 

pigrSm^S^  te  «*h  MODIS  determined 

of  the  satellite.  TOs  L^  cm  temSced  Z XY™  IT0*™1  by  «*» 
geochemical  normalization.  R °e  introduced  into  the  routine  processing  and  is  called  bio 


5.4  Image  Related 


5.4.1 


External  image  related  radiometric  rectificatioi 


exposures  of  bedrock  may  have  a relatively  staMe  StabIe-  For  sample, 

radiomeoically  stable  areas  within  images  cant*  Iong  P*00^  of  *“».  These 

they  are  internally  self-consistent  v^tiie  stable  BorS>^  nfth*0^  p??ons  of  M ““SC  so  that 
applied  to  high  resolution  U^agc*  technique  is  generally 

of  the  technique  to  MO&  ” SP0T*  applicability 

Class-specific  scene  equalization 


5.4.2 


* •«*  * 


6 In-Orbit  Geometric  Characterization 

instmn^L^^e'^^mcnt  cf  tb^^nso^w^tiius  °f  V“W  °f  *• 

7 In-Orbit  Spectral  Characterization 
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8 Official  MODIS/MCST  Calibration  Algorithm 
8.1  Objectives/Rationale 

more 

likely  to  be  a combination  of  methods. 

g 2 Minimization  of  Instrument  Systematic  Noise  Sources 


8.3  MCST  Calibration  Flow 

, . \ir*!T  chall  take  into^account  all  instrument 
The  calibration  algorithm  produced  y ^ ^^e  input  and  ^digitized  output  of  the 
components,  both  optical  and  elecffomc,  accounted  for.  In  this  manner,  the  propagauon  o 

9 MODIS/MCST  Ca.ibra.ion  Aigorithm  Validatjgn^nd  Upgrade 


9.1  Algorithm  Correction  for  Systematic  Eixors'^Jp' 


:tion  tor  pystemauc  caiuia 

Systematic  error  scarce.  tha  ^ave 
bv  apptotionof  *e w£ch  is  manifested  as  pixel-to-pmel 

fixganem  nois. 


9 2 Inclusion  of  In-Hight  CaUbtadon  fcfo^non 
further  validate  and  upgrade  the  software  algorithm. 


9 3 Creation  of  Calibration  Error  Images 


y ^ V^rCilUUn  - . 

A .wcdimension^WP-^'  «"*  * - ""  °"  * 
wiU  be  created  after  r^^libranon  procedure. 


10  Definitions  and  References 

10.1  Data  Dictionary/Glossary 

10.2  Acronyms 


A 

AIRS 

ASTER 

AVHRR 

aviris 


Emission  and  Reflectance 
aScS  Verv  High  Resolution  Radiometer 
A^^me  Visible/Iidra-Red  Imaging  Spectrometer 
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EOS 

EOSP 

a 

GOES 

H 

FURIS 

M 

MOST 

MERIS 

MISR 

MODES 

MTF 

R 

NASA 

NOAA 


Earth  Observing  System 

Earth  Observing  Scanning  Polarimeter 

Geostationary  Operational  Environmental  Satellite 

High  Resolution  Imaging  Spectrometer 

MODIS  Characterization  Support  Team 
Medium  Resolution  Imaging  Spectrometer 
Muln-angle  Imaging  Spectro-Radiometer 


Modulation  transfer  function 

National  Aeronautics  and  Space  Administration 
National  Oceanic  and  Atmospheric  Administration 


Sea  Viewing,  Wide  Field-of- View  Sensor 
Santa  Barbara  Research  Center 

5DSM 


SRCA 


Solar  Diffuser  S tability  Monitor 
Spec tro-radiome trie  Calibration  Assembly 


10.3  Additional  References 
m(Wl)RangC’"  ^oto8rai^e^c^^^eCTing^Rem^« 


if 


■j 


i n 


MODIS  Calibrauon/Characterizauon  Plan 
J.L.  Barker  (NASA/GSFC/925) 


Version  1 13  April  1992 
9:56  AM  4/1/92 


DlUtf*  <a* 


of  3/19/92) 


N»i-isS«® 


CM.IS***10* 
’“nI  OUISBOO* 

* i itul  b 


, and  edited  by 

„ JSssas-  - (BCSt’ 

HOD  IS  cna  o,«ir«r 

"^SMC*  rlMht  C*"'‘r 

and 

Douglas  corp- 

research  and  ^ suit*  460 

’•«  iis^r-D' *^°  ■ 


L; 

\ ' 

L 

\ ■ 


3 t 


"*M-  «“"»»»  HAltDBOOK 
' summary 


0. 

2 " i introduction 

1,1  Overview 

Se i on«.  . 


overview 
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i.  in1rroductioa 

1.1  overview 

. _ , *-n  the  result*  of  the  radiometric. 

This  document  is  intended  as . Xatio£/chSa«erization  of  the  MODIS-N  instrument 
geometric,  and  spectral  c a Ubr at ion /cm  £ l998.  Readers  of  the  document  are 

scheduled  for  launch  on  the  EOS-A  “ o are  concerned  with  calibration,  but 

expected  to  be  those  in  thf  f ! Pr°M9QrDTs-N calibration  efforts.  This  document 
not  concerned  primarily  with  the  MODI  . £ rmation  8o  they  will  have  a clear 

provides  these  readers  with  sufficient  . ljn8>  Every  attempt  will  be  made 

picture  of  MODIS-H  calibration  / ch**a*^*\***  ft  is  the  intent  to  maintain  and 

to  make  this  handbook  succinct  yet  complete^^  available  to  both  EOS  and 

up-date  this  document  as  part  "eoSDIS^s* (EOS Data  and  Information  Systems)  DADS 
non-EOS  scientists  through  the  EOSDIS  s (two 
^Data  Analysis  and  Distribution  System). 

It  views  the  Eaxth  from  en 
MODIS-N  is  an  imaging  scanning  spectro-radiometer.  +55°.  The  instrument 

orbit  of  705  km.  and  continually  ,c*n.  trcS,  0.  toe  to  to  14.385  mm.  Th. 

measures  the  at-satellit.  0 25  to!  il  band.l  to  0.5  to.  (5  band.)  to 

SRrSZZSSSSS  tb.J5b^.<«.  .unmanned  in  Section  7.5. 

The  spectro-radiometer  itself  Ls  “*“2* 

2S  fou%^=tP“„dV.  *5254  interference  fflt.r.  provide  th.  higher  spectral 
resolution. 

calibration  mUtelito  ‘.Veelbly  which 

p“?id%“%*  m...ur“n  S',  wavelength  stability  cf  th.  instrument. 


1.2  science  Ca3 


Objectives 


The  MODIS-N  specifications  call  for ^a  l^and*^ co-regiBtration  of 



1.3  organizations  and  P.esppnsibll«Tl?g 

The  MOD  IS  characterization  Support  Team  ^^gP”^j8'h,h'irection  of*thenMODIS 
coordination  the  ground  calibration 

anr?hIrac«riza?ion  and  demonstrates  that  the  specification,  are  met. 

2.  J-s-Laupeh 

2.1  Objective  /RatiSHfrlS 

Before  launch , teflt3  wil  1 ^atin^of *1^° f ollotilV  rad^oMtric  properties t Gain, 
versus  radiant 

calibrator  performance,  f/tion  Transfer  Function  (MTF)  will  be  measured 

band-to-band  stability.  snectral  band  shapaa  and  out-of-band  radiation 

along-track  and  across-track.  P including  rise  tima  and  ovarshoot 

levels  will  be  measured.  Thetransientre^  rise  ^ MMur.d>  The 

or  undershoot  will  be  ta 3nc nal? lacktnd  croastrack  will  be  measured.  Most  of 
spectral  band  ^^“^^^r’axnbiehe  conditions  and  under  vacuum  conditions. 
f”LrS929WLdiffeeremnt  types  of  characterization  test.  ar.  plann^i. 
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sumuriidd  whan  tray  bacosa  public.  *’  aarly  planning  atagaa  and  win  ba 

==ntr.«cr*^.C^bSf^^"-  th*  «**«T  input 

m Assa^srigSS  £ss 

SS  5S35&  c’fc.iSiU!1” 


“s *£sust!"£K  ^ssrsjsi  ? r^r-’  * ■— ■ •*  — 

measurements  of  band-to-band  registration  coh®™^*tr*  **naitivity  check  and 
raaponaa.  optical  ali,n»a»t.  SSSTSSj^lSf^ToSSt 


2*2.1  absolute  Calibration 


visible  and  MST-inSSSTS' ± in  the 


2.2.2  Bgla&jvg  Calibration 


«^A\trr“r^irr*.d“17.ct°1onh!  JSr«i*™.'.  * 


+ 0.5% 


2-3  can hrat ion 

The  pointing  accuracy  of  MODIS-N  will  he  suf  f i f*<  «-«  t 

Earth's  surface  to  with  •*•  0 5 tim®.  a-iff  ,C1®2?L t0  iocat#  any  pixel  on  the 
Registration  of  pixels  to  "o.l  pixef  or  better  "will  °b*  Winth  „°f  th*  PLX*X' 
knowledge  of  20  arc  seconds  and  alignment  chan^.i*1*^  mada'  but  a pointing 
the  overall  pointing  knowledge  to  ofTJSelJ  JletLn  a“°  !*COnda  win  reduce 
geometric  calibrations.  pA>  s®cti°n  4 as  devoted  to  in-orbit 

2*4  Spectral  Calibration 

The  spectral  response  of  MODIS-N  as  a funri-tnw  * ■ 

measured  with  sufficient  accuracy  so  thatHhl  f tun1#,  mU8t  *ith*r  *>•  stable  or 
goals  are  reached.  MODIS-N  has  a So®ctro-r*^!  overall  radiometric  calibration 
which  allows  the  soectral  re soonse^of  th®  <*lom*tric  Calibration  Assembly  (SRCA) 

««10»  5 ii  "oni“r“S 

3"  te&issmzis.  CAlitotion /Characters  mj?n 

3*1  2tel get ivesy Rationale 

in  o^oit "wi^ thaf  in^ia^in-orbi^calibr^itn1  to  be  kn°Wn  "diation  sources 
within  specifications  during  the  raisslon  i^  Mult?^!  ~aauvf*d  *nd  “aintained 
and  sources  will  be  used  to  obtain  the  necessa^  ibration  t^chni'iues 

3.2  through  3.5  describe  different  calibrat/?*  accuracy.  Sections 

^ h“—  multiol.  a«Sb"lh^iA£j5io?  t“CAn,15UM^._Thf  approach  to 


a single  official  calibration 


synthesizing  the  multiple  approaches 
algorithms  discussed  in  Section  6. 

3,2  i.C3tr~ment-9ased  Calibration 

Radiometric  calibration  of  MODIS-N  will  h»  . , 

to  establish  the  instrument's  response.  These  Jcnown°snh  th*  *J**  of  3cnovm  a°«rces 

^ ‘ Tfta«a  known  sources  include  the  Sun,  the 
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* aCT-ai' '*1  3 *jJT- jpace, blackbody,  and  IflildstiiMiOtot  J 
3.2.1  soectro-Radiometric  Calibration  ftgggmDlV  (SRCftl 

A smale  blackbody  operating  at  the  ambient  temperature  will  be  uaed  to  calibrate 
the  MOD  IS -N  thermal  channels . the  blackbody  will  be  viewed  once  per  ecan  and 
calibrate  channels  20  through  36.  The  blackbody  itself  is  aluminum  with  v-groove 
cuts  of  25°.  Its  effective  emissivity  is  0.992  or  greater. 

The  Spectro-Radiometric  Calibration  Assembly  (SRCA)  can  be  used  for  radiometric 
checks  in  the  visible  and  near  infrared  since  it  has  an  incandescent  source.  It 
can  be  used  at  any  time  during  the  orbit.  The  SRCA  is  also  used  in  spectral 
calibration  and  spatial  registration  studies. 


3.2.2  solar  Diffuser  Stability  Monitor  (SBSM1 


A solar  diffuser  plate  is  part  of  the  MODIS-N  design.  It  can  be  used  to  calibrate 
channels  1 to  7 and  17  to  19  once  each  orbit.  The  properties  of  the  diffuser 
plate  are  monitored,  in  turn,  by  the  Solar  Diffuser  Stability  Monitor  (SDSM)  which 
alternately  views  the  sun  and  the  diffuser. 


This  method  of  calibration  is  a primary  method  of  calibration  since  the  entire 
optical  path  of  the  instrument  is  monitored. 


3.2.3  External  Lunar 

MODIS-N  can  view  the  moon,  once  per  month  in  the  spring  and  autumn,  when  deep 
space  is  viewed.  For  4 to  6 times  per  year,  for  periods  lasting  about  one  day, 
the  moon  is  visible  in  the  deep  space  scans.  The  moon  is  an  extremely  stable 
radiation  source,  which  potentially  allows  it  to  be  used  for  calibration.  The 
intensity  of  the  lunar  disk  will  vary  during  the  year  as  the  Earth-Sun  distance 
chanoes  and  will  also  vary  with  the  lunar  libration  angle  and  phase  angle.  The 
MODIS-N  design  only  allows  the  moon  to  be  observed  when  it  is  in  a gibbous  phase 
about  22.5°  beyond  the  half-moon  phase.  Given  the  precise  illumination  and 
observation  geometry,  a high  sDatial  resolution  model  of  the  spectral  radiance 
from  the  moon  will  be  calculated.  This  radiometric  image  will  then  be  transforms 
to  match  the  resolution  and  orientation  of  MODIS-N.  Periodically  then,  MODIS-N 
wrll  be  exposed  to  a stable  radiometric  source,  allowing  the  long-term  stability 
of  the  instrument  to  be  monitored.  Hugh  Kieffer  of  the  USGS— Flagstaff  is  the 
orincipal  investigator  for  lunar  calibration;  Dr.  Kieffer  is  a Team  Member  of  both 
the  ASTER  and  HIRIS  Facility  Teams. 

This  method  of  calibration  is  a primary  method  of  calibration  since  the  entire 
optical  path  of  the  instrument  is  monitored. 

3.3  Instrument  Cross-Comparison  Methods 

3.3.1  rr?ffla~??Pgor/within  P-atform 

Several  passive  remote  sensors  using  visible  radiation  are  planned  for  the  EOS-A 
platform.  Each  instrument  will  be  independently  calibrated.  After  corrections 
for  differences  in  footprint  size,  spectral  resolution,  and  pointspread  functions 
are  made,  the  radiances  measured  by  the  separate  should  agree  to  within  their 
accuracies.  If  they  do  agree,  it  tells  us  that  any  biases,  whether  the 
bias  is  zero  or  not,  are  the  same.  The  more  instruments  that  agree,  the  more 
confidence  we  can  have  that  correct  measurements  are  being  made.  Potential 
comoarison  instrument  include  MODIS-N  (am)  to  MODIS-N  (pm),  MODIS-T,  AIRS,  ASTER, 
EOSP,  and  MISR.  Several  of  these  potential  configurations  are  discussed  below. 

AIRS  (Atmospheric  Infrared  Sounder)  has  a 13.5  Ian.  nadir  footprint  with  five 
channels  in  the  visible  region  from  0.4  to  1.1  microns.  Inter-comparison  to 
MODIS— N will  consist  of  combining  many  MODIS  pixels,  weighted  by  the  AIRS 
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'^^^^*Ct:::£anCt£0n>;"'ta  image  X£ke-a  singleAIRSpixel.-  Bmhum  modtc  m 

also  appears  to  have  better  spectral/  resolution  in  the  visSS  ^°IS’? 
appropriately  weighted  MODIS-N  bands  will  be  required  to  ilS  \hl  7?X 

3ZE*£ 

-e 

ss 

-j*“  « ” -WTSSSS."  5SSSJ  3?WS5?SS 

JSTrA*^S!USl*ESS  h„ODIS  Kr^ii  "*dlr  ‘°°^^nt  «■* 

«iuW!aa£ffM  “ Si  KiSS 

matched  by  MODIS-N  bands  at  443  and  ass  „t,  atT-*,44£*  *“d  ®6®  01,1  whicft  are  closely 
i.  not  nvillabl.,  buSprobSiy  1.1...  tT^  HODIs"*^*  ^''  r"°1?'lon  <«  HIS* 
MODIS-N  and  spatially  re-mappina  MISB  B£  ■P«f«rally  re-mapping 

app.«r.  pon.ill.  whiS'JiKuL"^  to7S-XS.  “*  t“° 

Wf  ££  raVlTr.  » nS“°.*: 41frr|1°n  S'  Dr'v.LhUiP  S1«"'  Pl“*  to 

“lih  AV™'-sw  «**£**-  SfiS/SKi.  TL\y 

3*-3*2  Crpss-PXatform  In-Orbit 

°5S,IKlli2S £ot  rn".t,».c^?A^*M,,“Sch  Uk*  «- 

comparisons  between  two  satellites  is  that  n»A*iL  diff^cu^tY  and  drawbacJt  in 
same  region  at  the  same  ViZ  so  iatciiS  iaJIuS.^nd over  the 
obtained.  Without  the  geometry  and  tem^ral  matth  thl  T i“  9«oo«tries  can  be 
considerably  more  involved  Som*  noro^isi  m*tchr  the  inter-comparison  become 

SPOT,  and  xlndaS  .TLS.J “ ^ Sff  ,2™”'*  “•  *™». 

SeaWiPs,  GOES,  and  other  satellite,  are  also  p^tlSi?  co«Pari.on.  with  MERIS, 

AVHRR  (Advanced  Very  High  Resolution  Radiometer)  hae  a 1 l l™  „.*<  * * 

wnich  is  close  to  the  1 km.  nadir  footprint  for  *om»  "wnntVi  nadir  fo°*Pnnt, 
a lower  spectral  resolution  than  MODIS-N  AVHRR ^ Chann..  T chann«i»-  AVHRR  has 
or  about  550  to  700  nm  and  channel  2 co^er^out C?M°t  = 

MODIS-N  bands  centered  at  531,  565  653  681  7*n  aie^onZ^  Weighting  the 

the  filter  transmission  of  the  AVBB  LSL5°'.?u'  90S'  936'  and  940  bY 
type  scene  to  be  constructed  from  the  modis  n r>t  filte”  shouid  allow  an  AVHRR 
fiignc  *U«n  t^SSThl^  « ^ 
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*1  !.>,«.  Tfc  ia  not  claar  • that-  using  thm -pre- flight 

r:haiit?e - ?rc?ertia«  i<»  £*-fg^t,  i ltg>  Another  drawback  with  the 

transmission  functions  ■ will  giv  AVHRR  sansors  ara  not  wall  calibrated. 

AVHRR/MODIS-N  inter-comparison  is  that^a  flying  in  tha  MODIS-N 

It  is  also  not  clear  if  tha  present  A^  de^ign  ^11  ^ lifflitad  to  thoi.  timas 
era.  Finally  comparison  between  the  ^h!„  as  yet  to  be  defined  window  of  time, 

whan  both  are  crossing  the  same  scene  within  as  yet  t 

. oa»aPii  visible  bands  which  offer 

SPOT  has  a 10  mater  nadir  f®®tprin_  sp0T  images  can  ba  spatially  re- 

opportunities  for  inter-comparison  with  M re!mapped  to  achieve  synthetic  images 
mapped  and  MODIS-N  images  can  be  spectrally  re-maPP«w 
which  can  be  inter-compared. 

_ ...  __j  bands  covering  450-520,  520- 

Landsat  has  a 30  meter  nadir  f °°  tJ3r  *0000  re  unit  ie  s for  inter-comparison  with 

600,  630-690,  and  760-900  nm  which 1 of _fer  °^p  gapped  and  MODIS-N  images  can  be 

“Silr' '££££?' ^C»fev.  .y&W.”  ich  can  ...  inbar-ebmparad. 

?£.“2«u*i£s  in  “iriidis:  s”n«i^^nir^si;*^-s5oT 

comparisons . 

3.3.3  Target  Belated/AiggyaiS. 

MODIS-N  radiance.  will  be  compared  “ t“/*dui,‘^°"  “"S^oni?"  Sl'^W* 
aircraft  auen  a.  HMV * c«££i=n. Jf  bh.  order  of  1...  than  5%  for 

spectroradiometer.  Except  for* > scattering  above  the  aircraft,  co-located 

the  path  radiance  causea  by  Bam..  The  technique  assumes 

radiances  from  these  two  ®®"  s/rellite  radiometers  remains  unchanged  over  time  and 
the  spectral  response  or  the  i only.  co-location  of  the  aircraft 
measured  changes  in  response  are  gam  ch  ^®  f°ne-tuning  the  navigation  of  the 
and  satellite  observations  can  b®  “°"*  Jiyb  twaen  the  two  sets  of  measurements 
satellite  such  that  the  maximum  an  be  re-calibrated  in  the  laboratory 

is  achieved.  Since  the  V-rCra^^td  th^technioue  allows  the  MODIS-N  observations 
with  traceability  to  NIST  standards,  the  technics  allows^  ^ of  tha  E0S 

to  be  maintained  to  within  9®v®f*\*“C®^  use  when  significant 

ssssic^dsars: ; « *. 

3.4  Tarcet-Based  CallbrjtSJbOn, v.^tfrodS 


3.4.1  Target  Relate  rmiva  Fqflectance 


observation.  SrtS 

calibration.  The  f oUou.ng  rub-t.ct ion.  .d..cr^^n«^  dativM 

observations  of  pigment  concentrate  differsneein  the  two  determinations 

values  for  the  same  pigment  concentration.  A difference  fay  altering  the 

can  indicate  a calibration  problem  ®x"a^  ^ista?0"^  technique  may  not 

calibrat^th^soectrometer^^o^much  as  tune  the  spectrometer-radiative  transfer- 

pigment  concentration  algorithm  combination. 

MODIS-N  radiances  can  also  ^p^red  ^to  structure 

radiative  transfer  mod®^.L®  * BUred  1 Co-located  g^ind  and  satellite  measurements 
?^l\“°*C«l  ”r«Ion  of  the  Ur.llic.  eeneor  bo  be  cbedlced  «oo»  ..  1.  d»». 
using  high  flying  aircraft. 

characoeriring  abcioopharic  opbica** ^Tpbh  aTIIfun^idn  ofPwav.langbh. 

» Sd^  ^obd...  or  bdb.l  preclpibable 
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^®l?oP"  m®t®3TS-  -using- '-either  >ol»r  • or"  fticrowave  radiafiA*'  - • _ . 
3p.ctrom.tara  can  provid.  total  ozone  amount..  A.ro^prop.rtiM  k.  ^ 

uaxng  lidar,  sunphotometers,  aur.ol.  meters! c«ESi  2r^.^.* -Uf!2 

slZn?iLO?mt*r?<  11iVing  thB  diffuse-direct  ratio,  or  pyrh.liomet^^T^S  wi£h 
Schott  glaaa  filters.  Th.  combination  and  choic.  of  instruments  haa^S?^  22 

3*4.2  BiO-OPtlcal  Oceany 

SSStufiZIZSiszS!"  th*  1"*t"”*nt  “ i£L5 

3.5  Image  Related 


3,5,1  SxtPnial  Tmaq?  Rglgpgd  Radiometric  Rectification 


2SS2.  "exposure.'  oT^SbSf * may  havV  a"  r^la  SST -table.  For 
fried.  o<  tie,..  Th.,.  radicf  «?c.l£  ,tii.  °’,r  _i“9 

correct  other  portions  of  an  image  «o  S Can  bB  U8ed  to 

with  the  stable  portions  of  th.  iL »am  Th.  t*0  i”ternallir  -elf-consistent 

image  radiom.tr icYect if ication-  afd*  4.  « technique  is  referral  to  as  -within 
iff.  .ueh  i.  tho,.pred‘c.dby 

t.chnl<ju.  to  modis-n  iuf.  will  b.  r....reh.d  M^pgliU.  V 

3,5,2  CJ,^?a~?pect,f4g  Scene  Equalization 

»sni":u"™  «.th,u.«th;^r71,10r*^°m:”i' ""ific*tion  m which 

staoility.  1 also  be  emPl°y*d  for  monitoring  the  MODIS-N 

4-  In-Ortit  Geometric  Calibration 

cons ists  of  ^an^incandescent^lamp^ource^hich^ll^inat.ii".^^^  Th*  aM0mbly 
spectrometer  that  provides  a lioht  illuminates  a double  pass  grating 

spect ro- r ad i omet er  f When  a recticle  pattern  is  * *2  the  *cannia9 

slit,  the  alignment  of  spectro-radiometer  can  be  moasurnd^nd^m ,°fJih0  SRCA  8x11 
measurements.  * ®aa*ured  and  compared  to  previous 

5*  In-Orbit  Spectral  Calibration 

incandescent  lamp  source  which  ilwTnates  ^ a^oubl.'n*  Th*  asaeobly  c°neists  of  an 
provid..  . light^aourc.  o, 

6 QXiZial  WPIS-W/MCgt  Calibration  Al^rlthme/M^.i  r 
6-1  Objectives /Rational. 

»•  u.M  to  d.t.rminod 

.or.  ub.1T  to  o. . t-s&si 
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applying- thi.  algorithm  to  an .wrt  tte  r.w  Uv.1-1*  qunntxz.d  nla  to  lW-1* 
radiances* 

6.2  Algorithm  Sensitivity /Simulation  gWfll8» 


7.  initions - References'.  ■ and  Trtlf 


7.1  Tabl*  of  Personnel  to  Contact  for  More  Information 


TOPIC 

CONTACT  PERSON ( S ) 

| TELEPHONE  1 

General 

John  Barker 

Phil  Slater 

301-286-9498 

602-621-4242 

Ground  Calibration  of 
MODIS-N  alone 

Jim  Toung 

Cross-calibration 
orior  to  flight 

Bruce  Guenther 
Phil  Slater 

301-286-5205 

602-621-4242 

Tn-f lioht  Calibration 

John  Barker  _ 

301-286-9498 

Cross— calibration  in 
orbit 

602-621-4242 

Calibration  using 
Ground-Truth 
Measurements 

Phil  Slater 
S.  F.  Biggar 

602-621-4242 

Calibration  using 
Aircraft 
Underf liahts 

Peter  Abel 
Mike  King 

301-286-6829 

301-286-5909 

End-of-Flight  Tests 

John  Barker 

301-286-9498 

Thermal  Calibration 

Peter  Abel 

301-286-6829 

Visible  Calibration 

John  Barker 

301-286-9498 

Lunar  Calibration 

1 Huan  Kieffer 

602-556-7015 

EOS  Calibration  Plans 

I Bruce  Guenther 

301-286-5205 

7.2  Data  Dictionary /Glossary 

7.3  Acronyms 


h 

AIRS 

ASTER 

AVHRR 


Atmospheric  Infrared  Sounder  J _ „ 

Advanced  Spaceborne  Thermal  Emission  and  Reflection 
Advanced  Very  High  Resolution  Radiometer 


£ 

EOS 

EOSP 


Earth  Observing  System 

Earth  Observing  Scanning  Poiarixneter 


G 

GOES 


Geostationary  Operational  Environmental  Satellite 


I 

IF  OV 


Instrument  field  of  view 


X 


7 


">*  MCST  - 
MERIS 
MISR 
MODIS-N 
MODIS-T 
MTP 


MOOTS  Characterization  Support  Team 
Medium  Resolution  Imaging  Spectrometer 
Multi-angle  Imaging  Spectro-radiometer 
Moderate  Resolution  Imaging  Spectrometer  - Nadir 
Moderate  Resolution  Imaging  Spectrometer  — Tilt 
Modulation  transfer  function 


I! 

NASA 


National  Aeronautics  and  Space  Administration 


2 

SeaWiFs 

SBRC 

SDSM 

SRCA 

z 

TM 


Sea  Viewing,  Wide-Field-of-View  Sensor 
Santa  Barbara  Research  Center 
Solar  Diffuser  Stability  Monitor 
Spectro-radiometric  Calibration  Assembly 


Thematic  Mapper 
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I 
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r"  unnTC  nttrr  INFRARED  FOCAL  PLANE  CHANN1 

SItS 

Channel 

Central 

Wavelenoth  (um> 

Bandwidth* 

(micron*) 

signal  to 
Noise  Ratio 

Number 

i 

0.659 

0.050 

241 

0.865 

0.040 

438 

4 

0.653 

0.015 

1630 

13 

0.681 

0.010 

1238 

14 

0.750 

0.010 

1061 

15 

i A 

0.865 

0.015 

1053 

« w 

0 . 905 

0.030 

463 

17 

T Q 

0.936 

0.010 

119 

19 

643 

9 


Channel 

Number 


_M?DIS  SHORT  AMD  MID-RANGE  INFRARED  FOCAL  PLANE  CHANNELS 


Central 

Wavelength  fum> 


1.240 


1.640 


2.130 


3. 7S0 


3.750 


3.959 


4.050 


4.465 


4.515 


4.565 


Bandwidth* 

(micron*) 


0.020 


0.020 


0.050 


0.180 


0.050 


0.050 


0.050 


0.050 


0.050 


0.050 


Signal  to 
Noise  Ratio 


— t^-THERMAL  or  long-wave  infrared  focal  PLANE  cmmwttT.s 


Channel  Central 

.Number Wavelength  fum> 


Bandwidth* 
(micron*  > 


Signal  to 
Noise  Ratio 
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Eos  Radiometers 
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Spectral  Coverage 
Specific  Design 


tf  blgg&r.  1992-64-63,  vg 


Philosophy 

Portable 

Stable 

Precise 

Accurate 
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Spectral  Coverage 

0.4 -1.0  pm  (Silicon  QED) 


0.8-  1.65  pm 

1.5  - 2.5  pm 

3.5  - 14.5  pm 


(Germanium) 

(cooled  Indium  Arsenide) 

(cooled  Mercury 
Cadmium  Telluride) 
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Silicon  QED 

Design  Considerations 
Fabrication 

Data  collection/storage 
Concerns 
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Design  considerations 


Spectral 

0.4  - -1.0  p.m 
Silicon  detectors 

(3  Hamamatsu  S1337-1010BQN) 
Interference  Filter(s) 

Radiometric 

No  optics  (other  than  filter) 

Precision  apertures  (2) 

QED  (5  detector  surfaces) 

Thermal 

Temperature  control 
Detector  / Amplifier 
Apertures 
Filter 
Material 
Invar 

Stainless  steel 
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Fabrication 

Custom  built 


Precision  tolerances 
detector  alignment 
position 
angle 
aperture 
centering 
diameter 
circularity 
separation 

Interchangeable  detector  blocks 
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Data  collection/storage 

Analog  outputs 
Detector  voltage 
Detector  temperature 
Filter  temperature 
"Instrument"  temperature 

Digital  outputs 

Filter  id  number 

Analog/Digital  conversion 
Commercial  data  logger 
1 7 bit  A/D 

0.03%  accuracy  (dev  / 1 year) 
Rugged,  compact  (3  kg) 
Commercial  data  acquisition  hardware 
1 7 bit  A/D 

0.01%  accuracy  (dev  / 1 year) 
Rugged,  transportable 

Storage 

Data  logger  (and/or) 

Small  MS-DOS  computer  (RAM  card) 

ft  1992-04-03,  p70^i^1\stu'comracrccaJta^ 


Amplifier 


Design 

Transimpedance  configuration 
low  noise  FET  type  OP  AMP 
temperature  controlled 
op  amp 

feedback  resistor(s) 
single  or  1 per  detector 

Variable  gain 
set  by  switch 
or 

digital  io  from  logger 
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Concerns 

Operating  Conditions  (vacuum  ?) 

Radiance  levels 

Scheduling 
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Calibration  Source 
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Dr.  Christopher  L.  Cromer 


NASA  Goddard  Sphere  Source  Measurement  Setup 


RESULTS  OF  NASA  SPHERE  SOURCE 
MEASUREMENTS  AT  NASA  ' 

(183  cm  diameter  sphere  with  25.4  cm  aperture) 


Detector  Filter 
Peak  Wavelength 
(nm) 

Source  to  Detector 
Distance 
(cm) 

Difference  of 
Predicted  Signal 
from 

, Measured  Signal 
(%) 

555 

190 

-0.2  * 

555 

150 

-0.1 

555 

* 100 

-0.1 

720 

190 

-0.4 

720 

150 

-0.2 
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Verification  Methods 

Sources  Radiometers 


Entrance  Optics 

• Aperture 
Telescope 
. Baffle  Tube 


Filters  ^ 

Absorbing 

• Interference 

• Monochromator 


Detectors 

. GaP 

• GaAsP 

• Si 

• Ge 

• InGaAs 
» PbS 

- InAs 

• InSb 


v 

.2  pm  - .5  pm 
.2  pm  - .7  pm 
.2  pm  - 1 .1  pm 
.9  pm  -1.7  pm 
.9  pm  - 1 .8  pm 
1.  pm  - 3.3  pm 
1.  pm  - 3.8  pm 
1.  pm  - 5.5  pm 
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Proposed  Geometry 


Radiance 


Telescope 


Temperature 

Controlled 

Housing 


■ 

Ilia 

■ 

Wideband 

Interference 

Filter 
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Irradiance 
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Integrating  Sphere  Temperature 
— ^ Controlled 

j Housing 

Y I \ 


Wideband 

Interference 

Filter 


Cryogenic  Radiometer  (0.01%) 


Working  standard 


Arrangement  of  photodiodes 
minimizes  light  lost  to  reflection* 


-Figure  5a 

Response  Uniformity 
Hamamatsu  Trap  #3 
0.1%  contours  at  S00 
1.1  mm  resolution 


Figure  gh 

3D  Plot  of 

Response  Relative  to 
Center  of  Detector  for 

Hamamafau  Trap  #3 
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ABSTRACT 

Measurements  of  solar  radiances  reflected  from  the  mirror  attenuator  mosaic  (MAM) 
were  used  to  calibrate  the  shortwave  portions  of  the  Earth  Radia ^basically 
Experiment  (ERBE)  thermistor  bolometer  scanning  radiometers.  Th 
a low  scattering  mirror  which  has  been  used  to  attenuate  and  reflect  sol 
radiation  into  the  fields  of  view  for  the  broadband  shortwave  (0.2  to  5 
micrometers)  and  total  (0.2  to  50.0+  micrometers)  ERBE  scanning 
MAM  assembly  consists  of  a tightly  packed  array  of  aluminum,  °-^5-cm  diamet 
concave  spherical  mirrors  and  field  of  view  limiting  baffles.  The  spherical 
mirrors  are  masked  by  a copper  plate,  electro-plated  with  black  chrome. 

Perforations  (0.14  centimeter  in  diameter)  in  the  copper  plate  serve  as  aPart,iraa 
for  the  mirrors.  Black  anodized  aluminum  baffles  limit  the  MAM  clear  field  ° 
to  7 1 degrees.  The  MAM  assemblies  are  located  on  the  Earth  Radiation  Budget 
Satellite6 (ERBS)  and  on  the  National  Oceanic  and  Atmospheric  Administration  N0AA- 
and  NOAA-10  spacecraft. 

The  1984-1985  ERBS  and  1985-1986  NOAA-9  solar  calibration  data  sets  are  presented. 
Analyses  of  the  calibrations  indicate  that  the  MAM  exhibited  no  detectable 
degradation  in  its  reflectance  properties  and  that  the  gains  of  the  shortwave 
scanners  did  not  change.  The  stability  of  the  shortwave  radiometers  indicates  that 
the  transmission  of  the  Suprasil  W1  filters  did  not  degrade  detectably  when  exposed 
to  Earth/atmosphere -reflected  solar  radiation. 

1 . INTRODUCTION 


The  Earth  Radiation  Budget  Experiment  (ERBE)  is  being  used  to  measure  diurnal 
variability  in  the  components  of  the  Earth  radiation  budget  over  the  entire  globe 
as  well  as  over  geographical  regions  as  small  as  250  kilometers  . The  components 
are  the  incoming  solar  radiance,  the  Earth/atmosphere-reflected  solar  radiance,  and 
the  Earth/atmosphere -emitted  radiances.  The  solar  energy  absorbed  by  the 
Earth/atmosphere  system  should  be  equal  to  the  energy  lost  to  space  by  the  process 
of  emission  if  the  system  is  to  be  in  equilibrium.  If  the  Earth/atmosphere  system 
absorbs  more  energy  than  it  loses  to  space,  the  Earth's  temperature  will  increase 
until  equilibrium  is  reached.  If  the  Earth/atmosphere  system  absorbs  less  energy 
than  it  loses  to  space,  the  Earth's  temperature  will  decrease.  The  ERBE 
measurements  have  been  used  to  evaluate  the  magnitude  of  cloud  forcing  on  the 
Earth  radiation  budget. 

ERBE  has  adopted  a goal  of  measuring  the  components  with  accuracies  approaching 
1%.  The  ERBE  mission  objectives  and  scientific  goals  are  described  by  Barkstrom  . 
The  ERBE  instrumentation  consists  of  three  Earth-viewing,  narrow  field  of  view 
(FOV),  scanning  radiometers;  four  Earth-viewing,  wide  angle,  nonscanning 
radiometers;  and  an  active  cavity  solar  monitor  which  are  located  on  the  NASA  Earth 
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Radliition  Budget  Satellite  (ERBS)  and  on  the  National  Oceanic  and  Atmospheric 
Administration  NOAA-9  and  N0AA-10  spacecraft.  The  ERBS  was  launched  September  5 
1984,  while  the  NOAA-9  and  NOAA-IO  spacecraft  were  launched  December  12  1984  and 
September  17,  1986,  respectively.  The  ERBE  radiometers  were  designed,  built  ’and 
ested  under  NASA  contract  by  TRW.  The  scanning  radiometers  are  described  by 
Kopia  while  the  nonscanning  radiometers  are  described  by  Luther  et  al.^  The  solar 
monitor  is  described  by  Lee  et  al.6  Calibration  results  for  the  scanning  and 
nonscanning  radiometers  have  been  presented  by  Lee  et  al.y  and  Paden  et  al  ® 
respectively.  ’ 

In  this  paper,  the  solar  calibration  instrumentation  and  approaches  for  the 
scanning  radiometers  are  described  in  considerable  detail.  Emphasis  is  placed  upon 
evaluating  the  stability  of  the  MAM  solar  diffusing  plate.  Flight  and  ground  MAM 
calibration  measurements  are  presented  and  compared. 

2 . INSTRUMENTATION 

The  solar  calibration  instrumentation  for  the  scanning  radiometers  is  the 
m rror  attenuator  mosaic  (MAM)  assembly  which  consists  of  baffles  and  arrays  of 
mirrors  which  guide  the  reflected  sunlight  into  the  FOV  of  a radiometer  The 
shortwave  and  total  scanning  radiometers  had  MAM  assemblies.  In  Fig.  1 the 

therFRR?e  and  ?°tal  ^anner^MAM  baffle  ports  are  shown  in  a schematic  diagram  of 
the  ERBE  scanning  radiometric  package.  The  telescopes  of  the  shortwave,  longwave 


Pedestal 


MAM  Baffle 


Earth  Scan 
Sensor 
Telescopes 


Fig.  1.  Earth  Radiation  Budget  Experiment  (ERBE)  scanning  radiometric  package. 

and  total  scanners  are  shown  at  the  bottom  of  the  package.  The  longwave  radiometer 

ijve  a **?"  assembly'  Tbe  longwave  portion  of  the  solar  spectrum','  less  than 
. % of  the  total  energy,  is  difficult  to  measure  at  the  1%  accuracy  level.  The 
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MAM  fret  entrance  ports  and  baffles  are 

Z S*e  ^.r.S^nl^t.l5  11  degrees  below  any 


Fig.  2 


Exploded  diagram  of  the  mirror  attenuator  mosaic  (MAM)  assembly. 


Fig.  3.  Elevation  view  of  the  MAM  assembly. 
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A'sr.jsz  rrrft  st™  «*  *• 

m the  MAM  assembly  permitted  rh!  a 1 F*g'  2'  1116  three  circular  apertures 

scattering  mirror  structure  Ineleva^  ^ the  ^ sol«  low 

Fig.  3.  Each  baffle  entrance  port  wls  5 ?3  \?  ^ “**  assembly  presented  in 

and  located  25.4  cm  from  the  MAM  mirror  structure^Th*  <Cm)  J”  ele^ation  height 
structure  was  oriented  15  decrees  below  >h  ^ \ Th  norinal  to  the  MAM  mirror 
entrance  pupil  entrance  fo-r  ? J t ^7  the  °Ptlcal  flxis  of  the  baffle.  The 

structure.  The  optical  axis  of  the  radial- WSS  loCated  9 14  cm  fro®  the  mirror 
normal  to  the  mirror  structure  In  thf  eleven ^ °riented  27  Agrees  below  the 
unobstructed,  clear  FOV  of  at  least  7 1 Ho  on  plane,  each  radiometer  had  an 
and  baffles  rejected  any  external  radi*mr  Phrough  the  MAM  ports.  The  ports 

Axis  of  the  baffle.  The  FOV  of  the  radiometer  was5!6?8^10"  “d  ab°Ve  5he  °Ptical 
its  entrance  pupil  was  1.27  cm.  ^ degrees  and  the  diameter  of 


rig. 


Azimuthal  view  of  the  MAM  assembly. 


TheWoptical  ^s^rthe*  h*0”5  ports  Were  4 10 

within  ± ;-2degreefof  - 

spherical  mirrors,  draper ti^^ask^s^adrof  Tf  °f  101  alumi"um 

C^e?%:r  = on 

3. 175-cm  by  3.175-cm  mask  had  0.14-cm  diameter  lltT  "t*  °°°5  centimeter.  The 
approximately  16%  of  mask  area.  The  sr!  Perforations  which  covered 

The  perforations  served  as  apertures  for  the  snh  • ° 3175  Cm  in  diameter 

geometry  of  a single-mirror  cell  is  shoL  The  mirr°rs'  In  Fig-  5>  the  ' 

deep.  Incoming  external  radiances  with^he  full  rlnT  7**  ?‘°9525  cent^ter 

me  tull  range  of  incident  angles  between 
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S iSLt  or 

remaining  samples  corresponded  to  observations  of  the”^  °t  Jhe  f?£*« ' 

degreZf Incide^f anglet  hlH  * . I"6  ? «* 

mirror  cells  into  the  scanners’  TOvT*  As^Uustr^M?1-  f Spherlcal 

optical  axis  was  oriented  15  degrees  abo^e  th.ZJ  c ” U'  6’  the  ba«la‘ 
observations  of  the  MAM  the  ori«*nr*«-f  e v surface  normal.  During 

to  the  MAM  normal  was  fixed  at  27  deerees°  Th6  scannersf  °Ptical  axes  with  respect 
In  volts,  and  the  voltagjs  we» convSed ' in«\h' T Sl6"als  °£  the  Scanners  «» 
measurement  units  usine  the  m,»h  ®?  t the  International  System  of 
et  al.10.  'iJt  pIv  of  Z baf?let«  T fas"lba'J  ^ I«  et  al.’and  H.lyo 

degrees  in  the  elevation  direction.  oalculated  to  be  approximately  7.1 


5°lar  calibration  geometry. 


it  ant  thr  alrabl»"  direction,  the 

The  angles  were  calculated  with  respect  to  the^tiM*^  ^ ff°m  6,d  b°  23'6  degrees 
direction,  the  Incident  angle  v.ri.r&.t  ^uTdegrees . ^ 


3.1  Ground  calibration  facility^ 


»t°r  fzt  evaiu*Md  to  dafi™ *-*  «eidS 

scanners'  gains  which  were  derived  from  observations  of™3^  the  quality  of  the 
reference  blackbody9.  The  attenuation  coeffill^  f inteSrati"S  sphere  and  a 
incident  shortwave  radiance  which  is  reflected  by  t^e^^^  th*  fracti°n  of  the 
and  is  sensed  by  the  radiometer.  The  MAM  assemble  £nt°  the  radio^ter's  FOV 

evaluated  in  the  TRW  vacuum  calibratio^h^ber^  whif^  1°*™***  Were 
Chamber  provided  a radiometric  environment  stttt  iti^. 
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. ■K-T.rrrY,  A 30. 5 -cm  diameter, 

It  was  2 13  meters  in  diameter  and  2.44  radiances  from  the  Sun.  In  the 

i-x&z  \zXuZuX  “tmS:r «- « r sss  Se 

“S'*”’  her  ^Lide  the  chamber,  a space  reference  source  ^ sl„uUted 

near-zerc^radiance  of  space  at  the  elevation  maintained  at  7.<* 

ne  r,.  uas  a 27  9 -cm  diameter,  grooved  o ' included  observations  of 

ZZ  liquid  nitrogen.  The  ground  calibration^e^ence  includ^  ^ dcscIibed 

the  MAM,  the  ICM,  ai  d the  simuiated^  radiometric  pacUage  was 

negative  angular -elevation  direction. 

The  incident  radiance  of  the  Xenon  were  located 

rHdr8the  TO^vacuum* cal ibr a t lo^ f ac i 1 i ty  and  in  the  i-Ment  beam^^Heasuremen 

f“‘dthf  EC™ and  solar  cell  astablished^tbe  temporal  uniformity  of  the 

ZZZs  f ound*to°b!* using1  the  “PR  ^^fusS°w  define  the 

magnitud^of'th^incident^'radiances . Therefore,  the  absolute  measurements  of 

r,  — * 


Space  ref.  source 


Fig. 


7.  ERBE  vacuum  calibration  chamber. 


ECPR  had  to  be 

calibrate  and  co""”  lcuUted  using  the  following  equation 
radiances,  rSw»  we 


- -4810  <VC„)  Wm'^sr‘1mw‘1 


spis  voi. 
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4.  DISCUSSIONS 

4.1  Ground  calibration  results 

is  varied  betueern'fand'u.  “degrees  withies'  C°nstan'12  as  the  incident  angle 
mirror  arrays  (off-axis  angles  of  *3  6 ?Pf  C°  the  noma!  to  the  MAH 

optical  axes  of  the  MAM  baffles)  Thf>  nff  belov  and  +3*6  degrees  above  the 
direction  to  the  incident  radiance  beam  and^h*  ;S  the  angle  betweer> 

This  angular  range  represents  the  calculi  the  °Ptical  axis  of  the  MAM  baffle 
baffles.  Therefore , the  reflected  solar  radf’  Clear  ™ ^rval  for  the  MAM 
dependence  upon  the  incident  angle  ^In  ^lances  should  show  no  detectable 
resultant  measurements  indicated  that  thTl  gr?U™?  equations  of  the  MAM,  the 
varied  inversely  with  the  incident ^ aLle  of  Se  i f th*  reflected  radiances 
FOV  ground  shortwave  radiometer  measurements ^exhibirsvft-1"3111^!5 ' In  Fig'  «•  the 
reflected  radiances  of  the  order  of  10%  (ERBS  anH^L^o?®  1C  decreases  in  the 
off-axis  incident  angle  interval  betwe^  5 L +3  f } tQ  20%  (N0AA  10>  ™er  the 
baffle  optical  axis.  This  range  corresponds  to  L range  With  resPect  to  the 

degrees  with  respect  to  the  MAM  normal . in  addit^^'t^^^LncT  “ ^ 18 


fig-  8,  Ground  shortwave  radiometer  mam  -.*■-! 

against  angular  distant*  el  incident  heln  ^'Se^tS^lf  ^^e^'hff: f !e  . 

unexpected  dips^th^^  ^ asaemblies  exhibited 

optical  axes  of  the  baffles.  The  ca^se  of  th^H65  a?proaching  ’1  degree,  near  the 

(off-axis  incident  angle  range  from  -5  to +3)’ wf^f  oun^T ' ^ Cl®ar  F0V'S 

; Were  found  to  be  larger  than  the 


/SP‘£  V0>  1493  Ca“breUOn  0fPas^  Observing  Optical  and  M,crowave  Instrumentation  (1991 , 


calculated  -3.6-  to  +3.6-degree  range  The  NoL^O 

agreement  with  the  .ca^"1^e^  19 83* 'November  20,  1983,  and  February  18,  1984. 

FOV  tests  were  conducted  on  May  6,  l > coefficients  for  the  shortwave 

in  addition  to  the  FOV  tests  th®at^  °983  tests  of  the  NOAA-9  scanners 
radiometer  MAM's  were  derived.  The  M y > ’ h d an  attenuation  coefficient 

indicated  that  the  MAM  for  the  sh< ’^Lter  ‘ ^ Se  magnitude  of  the  incident 
of  21.05%  in  the  direction  of  the ?0 Te'at^he  426.1  Wm^sr'1  level,  according 
radiance  from  the  Xenon  lamp  was  foun  . incident  radiances  was 

to  the  solar  cell  measurements . The  magnitude  of  i"c J* 7 Wm-2sr-l . The 

calculated  using  Eq.  1.  20.00%  for  the  shortwave 

November  20,  1983,  tests  of  The  solar  cell  indicated  that  the 

radiometer  MAM  attenuation  coefficient.  w -2sr-l  level.  The'  shortwave 

magnitude  of  the  Incident  radiants  was  lW-  tests  „f  the  N0AA-10 

radiometer  measured  77.1  W atten™tion  coefficient  for  the  shortwave  MAM.  The 

scanners  yielded  20.6/%  as  cn  ■.  incident  radiance  at  the  397.7 

solar- cell  measurement  yielded  the  magn  . reflected  radiances  from  the 

Wm'2sr-1  level.  The  shortwave  radiometer  measured  the  reflected  raoianc 

MAM  at  the  82.2  Wm^sr'1  level. 

The  total  radiometers  measured  not  only  < ^ich  we^ernmed  and 
reflected  from  the  MAM's,  but  also  the  longwave  J " had  to  be  subtracted 
reflected  by  the  MAM's.  Therefore,  the  rejected  shortwave 

from  the  total  measurements  In  order  to  define  the  MAM  ved  £r0B 

rSTiJaS  — - - 

MAM  FOV. 


Fig.  9. 

angular 


Ground  total  radiometer  MAM-reflected  shortwave 
distance  of  incident  beam  from  the  optical  axis 


radiances  plotted  against 
of  the  MAM  baffle. 
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maenitnrfpc  of  'u™  total  radiometers  measurements  indicated  “that  the 
magnitudes  of  the  shortwave  reflected  radiances  varied  with  the  off-axi*  t™**  i. 
angle.  The  ERBS  measurements  did  not  exhibit-  t-b»  « Zl!  cne  axis  indent 

profile  which  was  observed  in  £ shor^veLe  Se^bs^cllf'thh  eSI^T* 

been ^arying^ur ingSthebpe rlods* when  thfTT  l0nBW>Ve  co"P0TOnt  “h1^  might  have 
total  ran a a in  8 P riods  when  the  shortwave  source  was  in  the  MAM  FOV  The 

shortwave^radiometer^MAM^s  V”^  ***1?  “ in  the  Ca”S  ot  the 

and  +8  decrees  similar  re  rh  6 9t  cuc'off  F0U  angles  were  found  to  be  -9 
degrees,  similar  to  the  cases  of  the  shortwave  radiometer  FOV  measurements. 

4.2  Flight  solar  calibrations 

orbital  re^oLtion^  ^ during  a single 

November  20,  1984,  through  October  16,  1985  period^hile  th^N^r*^;!^6  th* 
were  conducted  for  a longer  oerinH  of  i P hil  the  N0AA~9  calibrations 

^ob:oiarc2ihrSS:hS  £*.&■£. 

n±?‘~  fro" faiun8  in  the  «»i«  c*Sbr«dti“.rii°  xes^hios:rsis 

scanning  radiometers  failed  May  1989  and  February  1990,  respectively 
The  scanner  automated  solar  calibration  sequence4  was  divided  into  thre* 

p^  olr  th^^aSiller8  b^V  IT'  7 Oration.  In 

during  each  4-second  tcln “"ST2  iicriS  “d  the  ICM 

radiometers  observed  .pace  ‘ ?*  uIn  the  first  Period-  the 

azimuthal  "A"  position  where  t£I  c r^anCe  source>  through  the  MAM  at  an 

where  the  Sun  could  not  be  observerdiw^irby^hf1 ^adion.^*  ^ b*£fl®  F°V'S  and 
space  position,  elevation  angle  of  163  degrees7  In  adioraete^s  at  the  reference 
radiometers  were  rotated  tn  It,  degrees.  In  the  second  period,  the 

through  the  baffle  ro“s  and  Us  radi^  P°  na" w"B”  “h're  the  Sun  ctmld  dr‘ft 

into  the  radiometers'  FOV’s  To  i '°'1?d  be  reflecte<i  by  the  MAM  mirrors 

back  to  azimutha  1 *pos i t io„S "A" ^where  L“  zeroriraii.tbe  stated 

observed  in  the  solar-calibration  scan ^mode  radlan'eS  fr0"  sPa“  be 

ephemerides  of  the  Sun  end 

spacecraft  axes.  The  uscerS  lf,2  baffle  axes  with  respect  to  the 

be  less  than  0.1  degrees  7 an£Ular  “l“l«iono  has  been  estimated  to 

In  Fig.  10,  flight  shortwave  radiometer  solar  raHia^^^r.  u* 
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shortwave  solar  radiances  are  ^ 

radiometers  . The  flight  exhibited, 

off-axis  incident  angle  than  the  g 
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angular  dis  tance'of 3 th^  incident  ST£«  blfflm. 

in  Fig.  12,  ERBS  -'“^alibration  measur^ents^are 

1984.  through  October  16,  198b,  perxo 


SPIE  Vo!  1493  Calibration 


of  Passive  Remote  Observing  Optica!  and  Microwave 


Instrumentation  (1 991 1 / 277 


pTvidedTheTeference  SF'SS 

2».ris^ 

longwave  cain  Th*  Portion  of  the  radiometer'^  j are  indlCative  of 

from  the  iS  verfderiverd^i0nS,f°r  th«  ^ r?  Ch3"*aa  the 

measurements  of  the  MAM  with  To  Th”  squares  analyses  of  the 10^1"^' CO,"P°ne,ltS 
temperatures  of  i-ha  k *rih  no  shortwave  source  nroQ«nt-  ^ total  radiometer 
December  198Q  „ tJ*®baffle  and  MAM  mirror  arrav  Pn  f C ^ the  corresP°ndinK 

distance,™  LTdT  T *°'**  rS.,tSlfTa°“,*,r  1584  though 

solar  monitors . Xhe  shorte£Senti3lly  constant  within  0 l%ld,15°  T6  016311  Earth/Sun 

foin  was  stable  d3ta  aat  indicated  thatTjf  T* 

was  primarily  caused  by  vaJubuft  S,  th\11-"lonth  Tk  Sca«  r T”' 

iT^TToTbe^r-H1"  ^ 

With  incident  anUe"”'  ****1™'  °f  the  reflected  rad'iaTcos'TidToTT,^' 


ERBS  solar  calibrat-i 

The  calibrations  time  series. 

2E,  1965.  the  total  and  1 TrCWaVa  p0rtl<>"  of  the totJ * decrease 
directly,  at  the  space accide„tallyTbsTTeT' tb0"cF'brUary 
extended  period  of  time  The  Position,  elevation  ancle  of  la  a the  Sun 
azimuthal  position  JSjr  , Th  accident  was  caused  by  a ftl  f 14  deSrees.  for  an 
P sition  mechanism.  The  direct  observations  T?  faI1“te  °f  the 

ions  of  the  Sun  caused  decreases 
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Observing  Optica,  art  MlCr0„ave  instrumentauon  {,991, 


,.AMf.r  sensitivity.  The  longwave  gain  of 
in  the  shortwave  portion  °f -^hanee^1  ^he  shortwave  radiometer  did  not  experience 
the  total  radiometer  did  not  change  . vl^  because  its  two  Suprasil  VI  filters 

«.  - sou, 

In  Fig.  13,  the  NOAA-9  flight  solar  *Jll^Jgl°^ertodltSThee radiance  measurements 
February  20,  1985,  through  December  24  1986  period^  ^ changes  in  the 

for  February  20,  1*85  were  used  as ”f*  time  series  indicate  that  the  radiances 

shortwave  and  total  radiometers  ga  n * caused  by  the  variability  of  the 

were  stable  to  +2%.  The  s?attar  ^ erbs  and  NOAA-9  measurements  indicated 

radiance  with  off-axis  incident  angle  ™e^ssemblies  did  not  degrade  over 
that  the  reflective  characteristics  of  the  MAM 
exposure  periods  to  space  as  much  as  2 years. 
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Fig.  13-  NOAA-9  solar  calibrations  time  series. 

5 . CONCLUSIONS 

The  MAM  assemblies  exhibited  no  detectable  de|£®d^°ht  solar  calibration 
properties  over  periods  aa™^  J changes  above  the  2%  level  in  the  amounts  of 
measurements  indicate  no  sig  ° MAM's  of  the  shortwave  radiometers, 

solar  radiances  which  were  ^^^^p^perties  of  the  MAM's  did  not  degrade. 

This  result  indicates  that  th  ains  of  the  shortwave  radiometers  were 

In  addition,  this  result  s^S^ts  that  h g i did  not  exhibit  any 

stable  at  the  ±2%  properties . Suprasil  VI  filters 

detectable  degradation  in  th  , , t solar  ultraviolet  radiation  . Since 

degrade  very  rapidly  when  exposed  directly  to  solar 
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H ”inl"1r<‘  the  —“i  •*  indirect 

have  exhibited  any  signifiLnt  detradaM^  filters’  the  filters  should  not 

During  February  1985,  the  sensitivitv  of  rh  " ^heir  transmission  properties, 
radiometers  decreased  approximately  7%  when^h*10^*^  P°rtion  of  the  ERBS  total 
to  the  Sun.  A correction  for  thi^H  h the  radiometers  were  exposed  directly 
data  reduction  algorisms.  d6CreaSe  haS  been  incorporated  in  the  ERBE 
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The  Forward  and  Inverse  Problems  in 
Remote  Sensing  of  the  Environment 

The  Forward  Problem 

Using  radiative  transfer  theory  and  relavent  geophysical 
variables,  model  the  upwelling  and  scattered  radiance  that 
a particular  instrument  should  measure 

Interpreters  - Required  to  specify  a base  state  around 
which  the  radiative  transfer  equation  is  linearized 

Classl  A priori  information  dependent 
Hydrodynamic  model  dependent 

Class  2 A priori  information  dependent 

Hydrodynamic  model  independent 

Class  3 A priori  information  independent 
Hydrodynamic  model  independent 

The  Inverse  Problem 

Using  upwelling  and  scattered  radiances,  invert  the 
radiative  transfer  equation  to  retrieve  geophysical  variables 
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2.2.2.  HIRS  channel  12  brightness  temperature 
climatology 
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Evaluating  NOAA  Satellite  Products 
for  Global  Climate  Monitoring 

by 

_ John  J.  Bates 

NOAA  Climate  Monitoring  and  Disgnostics  Laboratory 


L Validation  criteria  for  satellite  products 

2.  Long-term  global  validation  examples 

3.  Lessons  of  history  - Applications  to  the  EOS  era 


1.  Validation  criteria  for  satellite  products 


1.1.  Are  the  physics  of  the  radiative  transfer  sound? 


1 .2.  How  do  the  means  and  higher 
with  in  situ  measurements? 


moments  compare 


^ sPa^al  and  temporal  variations  in  the 

satellite  data  compare  with  other  observations  and 
hydrodynamic  models? 
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3-  lessons  of  histoiy  - Applications  to  the 
JEOS  era 

3.1 . We  must  establish  long-term,  global  validation 
programs  based  on  the  three  principles  of  validation 

3.2.  Both  satellite  and  in  situ  data  must  be  subject  to 
rigorous  quality  control  and  continuous  monitoring 

3.3.  Extend  and  examine  die  overlap  periods  of  similar 
instruments  on  different  satellites 

of  most  fields  must  extend  over  several 
eSi*  smce  most  s^ow  large  interannual 

variability  related  to  ENSO. 


3 X Lessons  of  history  - Application  to  the 
EOSera 

3 l We  must  establish  long-term,  global  validation 
programs  bas  ed  opthe  three  princes  of  validation 

3.2.  Both  satellite  andinsift/data  must  be  subject  to 
rigorous  quality  control  ar^continuous  monitoring 

3.3.  Extend  and  exaptme  the  overlap  periods  of  similar 
instruments  on  different  satellites  x. 

3 4 Samplin/of  most  fields  must  extend  over  several 
ENSO  cycles,  since  most  fields  show  large  lrtterannual 
variability  related  to  ENSO.  — 


P*f€*DtN€  PAGE  BLANK  NOT  FK.MED 


<? 

v-> 


'/0-/3 
■ / 7/5 o / 

NIST  N 94- £36^5 

National  Institute  of  Standards  and  Technology 


Non-regulator; ' agency  (Department  of  Commerce) 
Congressional  mandate: 

Assist  US  industry;  Improve  health,  safety,  and 
environment;  Conduct  fundamental  research  in 
science  and  engineering 

1989  Trade  Bill  added  responsibility  for  extramural  programs, 
especially  in  the  areas  of  "competitiveness". 


Radiometric  Physics  Division 

National  standards  in  radiation  thermometry, 
spectroradiometry,  photometry,  and  spectrophotometry; 

Dissemination  of  these  standards  by  providing  measurement 
services  to  customers  requiring  calibrations  of  the  highest 
accuracy; 

Conduct  fundamental  and  applied  research  to  develop  the 
scientific  basis  for  future  measurement  services. 


1 i 

I m 


NIST  SRM’s 

* 

Standard  Reference  Materials 
SP-260  and  Appendix 
(301)  975-6776 

EXAMPLES 

SRM  740  and  741.  Defining  fixed 
point  for  freezing  zinc  (419.58  °C)  and 
tin  (231.9681  °C)  for  calibrating 
thermometers  and  thermocouples. 

SRM  1967.  High  purity  platinum  wire 
for  thermocouple  construction. 

SRM  1920  (0.74-2.0  ju, m).  Reflectance 
standard  for  establishing  the  accuracy 
of  the  wavelength  scale  of  a reflectance 
spectrophotometer . 

SRM  2021  (0.28-2.5  jam).  Directional- 
hemispherical  reflectance  (black 
porcelain  enamel) 


NIST  Calibration  Services 
SP  250  and  Appendix 
(301)  975-2002 


EXAMPLES 

Contact  Thermometry:  Calibration  of 
thermometers,  thermocouples,  and 
platinum,  germanium,  and  rhodium- 
iron  resistance  thermometers 

Radiation  Thermometry:  Calibration  at 
650  nm  of  optical  pyrometers  or  ribbon 
filament  lamps,  800  °C  to  4200  °C 

Optical  Radiation  Measurements: 

♦ Spectral  transmittance  and  reflectance, 

0.25  to  2.5  /xm; 

♦ Spectral  radiance  ribbon  filament  lamps, 

0.225  to  2.4  /xm; 

♦ Spectral  irradiance  lamps  0.25  to  2.4  /xm; 

♦ Photodiode  (silicon)  spectral  response 
rental  package,  0.2  to  1.1  /xm; 

♦ Special  tests  of  radiometric  detectors,  0.2 
to  1.8  /xm,  10  /xW  and  greater  power 
levels; 


Selected  R/D  Programs 


Ambient  Environment 


TASK 


Ambient  IR  Facility  for  radiance 
temperature,  minimum  resolvable 
temperature,  and  imaging  studies 


Calibration  of  commercial 
blackbody,  10  °C  to  80  °C 


Characterization  of  commercial 
IR  spectroradiometer 


Calibrate  10-cm  aperture  water- 
bath  blackbody  (10  °C  to  80  °C) 


Build  and  characterize  tin-point 
standard  blackbody  (231.928  °C) 


Calibrate  blackbody  source  for 
radiance  temperature  and 
uniformity 


Detector  comparator  facility  for 
absolute  calibration;  develop  IR 
detector  standards 


Extend  photodetector  transfer  to 
standards  to  IR;  calibrate  with  the  10.6 
HACR  (High  Accuracy 
Cryogenic  Radiometer) 


WHO  DATE 


3-14  Navy  1987 


8-14  Navy  1989 


8-14  Navy  92-94 


3-14  Navy  92-94 


92-93 


1992 


91-94 


91-93 


Selected  NIST  R/D  Programs 


Cryogenic  Environment 


TASK 


Cryogenic  facility  for  calibration  0.3- 
of  blackbodies  from  total  power  30 
measurements  (LBIR) 


Calibration  of  blackbody  sources 
from  150  K to  1000  K 


Add  spectral  capability  to  LBIR  2-30 


Spectral  calibration  of  cryogenic 
sources,  detectors,  and  filters 


Extend  noise  floor  of  LBIR 
detector  from  20  nW  to  70  pW 


WHO  DATE 


SDC 

Army 


SDIO 

SDC 


1989 


1989 


1992 


1993 


SDIO  1992 


Selected  NIST  R/D  Programs 


Spectrophotometric  Measurements 


TASK 

X 

WHO 

DATE 

Calibration  facility  for 
bidirectional  reflectance 
distribution  function 

0.33- 

10.6 

90-93 

Develop  IR  diffuse  reflectance 
standards 

2-20 

Navy 

91-93 

Optical  heterodyne  densitometry 
(12  decades;  cryogenic  operation 
by  1992) 

0.633 

& 

10.6 

1990 

- 

Relevance  to  EOS/TIR  Calibration 
Current  Capabilities 

AMBIENT  (minimum  1 meter  path  length) 

Calibrate  customer  blackbodv  sources 

Calibrate  unknown  blackbody  for  radiance  using  a 
well-characterized  NIST  blackbody  source  by 
matching  the  radiant  fluxes  with  an  IR  radiometer 
(Barnes):  absolute  uncertainty  0.11  °C  at  10  °C; 
0.25  °C  at  45  °C;  capable  of  precision  of  1 mK; 

Measure  uniformity  of  unknown  blackbody  source 
with  a minimum  resolvable  temperature  difference 
of  50  mK  at  33  °C  (Barnes) 


Relevance  to  EOS/TIR  Calibration 
Current  Capabilities 

CRYOGENIC  (20  K shield;  4 K ESR  detector) 

Calibrate  customer  blackbodies 

Total  radiant  flux  measurements;  size  of  BB  aperture 
and  temperature  are  constrained  by  the  detector; 

Calibrate  thermometers  of  source  with  respect  to 
radiance  temperature  as  a function  of  BB  aperture 
size; 

Absolute  radiometric  uncertainty  at  the  95  % level  is 
about  1%,  corresponds  to  about  1.2%  uncertainty  in 
radiance  temperature; 

No  uniformity  studies  are  possible  and  strict  vacuum 
requirements  apply  (<  1.33x1 0"6  Pa  total  pressure 
and  < 1.33x1  O'8  Pa  hydrocarbons  before  cooling 
with  the  15  K helium  gas). 

Next  LBIR  workshop  is  scheduled  for  Tuesday 
morning,  September  15,  in  conjunction  with  the  3rd 
annual  SDL/USU  Symposium  on  Cryogenic  IR 
Radiometric  Sensor  Calibration  and  the  EOS/TIR 
Peer  Review  Workshop. 


EOS  TIR  Instruments 


Overall  Spectral  Coverage  (jam) 

AIRS  3.4  - 15.4 

0.4  - 1.7 

ASTER  8-12,1.6-2.5, 

0.5  - 0.9 

CERES  0.3  - 50,  8 - 12, 

0.3  - 5 

HIRDLS  6-12 

MODIS-N  0.415  - 14.24 

MOPITT  2.3  - 4.7 

SAFIRE  62.5  - 125,  25.6  - 32.3, 

6.4-  15.9 

2.3  - 16.7 


TES 


EOS/TIR  Lab  Source  Verification 
TIR  Round  Robin 


Definition  TIR  Round  Robin  to  VERIFY  the  calibration  of 
the  sources  that  are  used  for  the  absolute  radiometric 
calibration  of  the  individual  EOS  sensors 

Requirements  (preliminary) 

Spectral  response:  2.3  - 15 

3%  total  absolute  uncertainty  in  radiance  at  the  3 a level 

Long  term  stability 

Proven  vacuum  compatibility 

Meets  EOS  schedule 

Calibration  at  NIST,  or  NASA-acceptable  traceability 


Philosophy 


of  Lab  Source  Verification 


STABLE  SOURCE 


EOS  LAB  SOURCE  ROUND  ROBIN  SOURCE 

(Blackbody) 


1/ 

-1/ 


EOS  Instrument 


PRT  resistance  vs  Tx  of  the  RR  source  is  NIST 


"traceable” 


£rehkm  Thermal  radiation  properties  of  the  RR 
Source  could  change 


Option 


Return  to  NIST  often? 
design  way  to  monitor  e(A)? 


stahlpw  3 **  detector  (not  necessarily 
stable)  to  compare  the  sources  * 


STABLE  RADIOMETER 

(broadband  or  spectral) 
(irradiance  or  radiance  mode) 


EOS  LAB  SOURCE 


ROUND  ROBIN 
RADIOMETER 


Calibration  constants  determined  or  confirmed  by  NIST 
Round  robin  source  could  be  included  for  redundancy 


DESIRED  INFORMATION 


INSTRUMENT  SPECIFICATIONS 

CALIBRATION  METHODS  (pre-flight  and 
on-board) 


ROUND  ROBIN 
Overall  Philosophy 
Laboratory  Sources  to  be  verified 
Environment  for  measurements 
Revised  Requirements 
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Calibration  of  a helium-cooled  infrared  spatial  radiometer  and  grating  spectrometer 


Larry  Jacobsen,  Steve  Sargent,  Clair  L.  Wyatt,  Allan  J.  Steed 


Space  Dynamics  Laboratory 
Utah  State  University,  Logan,  UT  84321-4140 


/7/3  O 
^ // 


ABS3BACT 

Methods  used  by  the  Space  Dynamics  Laboratory  of  Utah  State  University  (SDL/USU)  to  calibrate  infrared  sensors 
are  described,  using  the  Infrared  Background  Signature  Survey  (IBSS)  spatial  radiometer  and  grating  spectrometer 
as  examples,  A calibration  equation  and  a radiometric  model  are  given  for  each  sensor  to  describe  their 
responsivity  in  terms  of  individual  radiometric  parameters.  The  calibration  equation  terms  include  dark  offset, 
linearity,  absolute  responsivity,  and  measurement  uncertainty,  and  the  radiometric  model  domains  include  spatial, 
spectral,  and  temporal  domains.  A portable  calibration  facility,  designed  and  fabricated  by  SDL/USU,  provided 
collimated,  extended,  diffuse  scatter,  and  Jones  sources  in  a single  cryogenic  dewar.  This  multi-function  calibrator 
allowed  calibration  personnel  to  complete  a full  calibration  of  the  IBSS  infrared  radiometer  and  spectrometer  in 
two  15-day  periods.  A calibration  data  system  was  developed  to  control  and  monitor  the  calibration  facility,  and 
to  record  and  analyze  sensor  data. 

1.  INTRODUCTION 


Electro-optical  systems  require  calibration  to  verify  instrument  design,  create  algorithms  necessary  for  data 
reduction,  and  estimate  measurement  uncertainties.  The  Space  Dynamics  Laboratory  of  Utah  State  University 
(SDL/USU)  has  been  calibrating  electro-optical  instruments  since  1970.  This  paper  describes  the  methods  used 
to  calibrate  the  infrared  (IR)  sensor  of  the  Infrared  Background  Signature  Survey  (IBSS)  experiment.  The 
calibration  approach  is  discussed,  as  well  as  the  data  collection  and  processing  methods.  Examples  of  the  results 
obtained  by  these  methods  are  also  provided. 

The  IBSS  experiment  is  a Strategic  Defense  Initiative  Organization  (SDIO)-sponsored  shutdebome  program 
designed  to  measure  ultraviolet  (UV),  visible,  and  IR  signatures  from  various  sources.  The  prime  contractor  for 
this  program  is  Messerschmitt-Bolkow-Blohm  (MSB)  of  the  Federal  Republic  of  Germany.  The  IBSS  hardware 
includes  a cryogenically  cooled  IR  sensor,  a UV,  visible,  and  near-infrared  spectrograph/imager;  a low-light-level 
television;  and  additional  instrumentation.  These  primary  instruments  are  located  on  a shuttle  pallet  satellite 
(SPAS)  that  is  based  in  the  shuttle  orbiter  until  deployed  for  measurement  missions. 


The  IBSS  IR  sensor  consists  of  a high  off-axis  rejection  telescope,  a spatial  radiometer,  and  an  Ebert-Fasrie  grating 
spectrometer.  The  radiometer  and  spectrometer  obtain  their  input  energy  from  the  telescope,  which  focuses 
energy  on  the  instrument’s  detector  arrays.  The  fields  of  view  of  the  29  radiometer  detectors  are  scanned  in  object 
space  by  an  internal  scan  mirror.  The  radiometer  has  a multi-position  filter  wheel  to  select  a bandpass  filter.  The 
12-detector  spectrometer  array  measures  6 different  spectral  ranges  simultaneously  as  the  diffraction  grating  is 
scanned.  The  sensor  operates  in  the  2.5  - 24  /un  infrared  spectral  region  and  is  housed  in  a helium-cooled  dewar. 
Both  the  radiometer  and  spectrometer  have  dedicated  on-board  signal  processors  that  DC  restore  the  chopped 
detector  responses.  The  IBSS  experiment  is  described  in  Lange  et  aL1 

■ 2.  METHODS 

2.1.  Calibration  approach 

The  approach  used  by  SDL/USU  to  calibrate  radiometric  sensors  involves  generating  a specific  calibration  equation 
and  radiometric  model  for  the  sensor  being  tested.  The  calibration  equation  and  radiometric  model  describe  the 
overall  responsivity  of  the  sensor  in  terms  of  separate  radiometric  parameters.2  The  calibration  equation  correlates 
sensor  output  to  measured  :1ux,  while  the  radiometric  model  describes  the  measured  flux  as  a function  of  the 
actual  flux.  The  calibration  equation  for  the  IBSS  radiometer  is: 

PW€§DtN€  PAGE  BLANK  NOT  FILMED 

SPIE  Vol  1340  Cryogenic  Optical  Systems  and  Instruments  IV  (1 9901  / 217 

ORIGINAL  PAGE  IS 

OF  POOR  QUALITY 


Cl) 


*m  - — LrCRcsP-DOr)  ± am 

** 


where  <t>m  is  measured  flux,  K(jft  is  absolute  responsivity  for  a given  radiomerer  filter,  Lr  is  the  radiomerer  linearity 
correction  transfer  function,  Resp  is  radiometer  response,  DOR  is  radiometer  dark  offset,  and  <7(j|t  is  measurement 
uncertainty  for  a given  radiometer  filter. 

The  calibration  equation  for  the  IBSS  spectrometer  is: 


<Dm(A)  - — — Lg [Resp (X ) -DOg]  a:  e(A)  (2) 


where  d>m  (A)  is  measured  spectral  flux,  51  (A)  is  absolute  spectral  responsivity,  Lg  is  the  spectromerer  linearity 
correction  transfer  function,  Resp(A)  is  spectrometer  response,  DOs  is  spectrometer  d^rk  offset,  and  a(\)  is 
spectrometer  measurement  uncertainty. 

The  radiometric  models  for  the  IBSS  radiometer  and  spectromerer  characterize  their  spectral,  spatial,  and  temporal 
domains.  The  relative  spectral  responsivity  describes  the  spectral  domain  of  the  radiometer.  The  grating  position, 
line  shape,  and  spectral  leakage  analyses  describe  the  spectrometer  spectral  domain.  The  field-of-view  response 
maps,  detector  positions,  scatter  coefficients,  effective  fields  of  view,  modulation  transfer  functions,  and  scan 
mirror  transfer  function  describe  the  spatial  domain  of  the  radiomerer  and  spectrometer.  The  radiomerer  and 
spectrometer  frequency  responses  describe  the  temporal  domains  of  the  sensor. 

Each  term  in  the  calibration  equation  and  each  domain  in  the  radiometric  model  describes  a specific  radiometric 
parameter.  The  goal  of  the  calibration  is  to  characterize  each  parameter  independently  of  the  others.  Together, 
these  individually  characterized  radiometric  parameters  comprise  a complete  calibration  of  a radiometric  sensor. 

22,  Portable  calibration,  source  (PCS) 


Since  individual  parameters  of  the  sensor  calibration  equation  and  radiometric  model  are  best  measured  with 
different  optical  source  configurations,  SDL/USU  personnel  designed  and  fabricated  a portable  calibration  source 
(PCS)  that  incorporated  four  optical  functions  into  a single,  ayogenically  cooled  dewar.  These  functions  included 
a collimated  source;  an  extended  source;  a near,  small-area  (Jones)  source;  and  a diffuse  scatter  source.  This 
multiple-function  calibration  source  eliminated  the  sensor  wann-up  cycles  usually  required  to  mate  different 
calibration  sources  to  the  sensor,  enabling  calibration  personnel  to  collect  all  data  required  for  a full  calibration 
in  two  15-working  day  periods.  Wyatt  et  al.  provides  a full  description  of  the  PCS. 


2.3.  Calibration  data  system 

SDL/USU  personnel  developed  a computerized  calibration  data  system,  consisting  of  commercially-available  and 
SDL/USU-designed  hardware  and  software,  to  control  the  PCS,  collect  the  IBSS  telemetry  stream,  and  analyze  the 
resulting  calibration  data.  The  system  recorded  individual  "snapshots"1  of  the  telemetry  stream,  automatically 
inserted  a header  describing  the  current  configuration  of  the  calibration  source,  and  stored  the  snapshots  on  a 
peripheral  optical-media  mass-storage  device.  The  data  system  then  rettieved,  processed,  and  organized  the 
snapshots  into  a calibration  data  base.  This  system  greatly  reduced  the  time  previously  required  to  complete  data 
analysis,  allowing  calibration  personnel  to  perform  all  analyses  needed  to  prepare  quick-look  reports  within  two 
weeks  of  data  collection,  and  to  complete  the  final  calibration  report  in  six  months. 
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; Xrefore  the  cdibrati™  described  in this  paper  correlates  the  amplitude  of  the  complex  response  to 

computed  by  the  onboard  signal  processor,  and  reported  by  telemetry. 

3.  RESULTS 

Calibration  personnel  devised  and  carried  out  tests  to  determine  each  term  in  the  calibration 
characterizeeach  responsivity  domain  in  the  radiometric  models.  The  test  results  presMtedmt^pp 
«Soles  of  the  data” obtained  for  the  1BSS  calibration.  Where  applicable,  data  from  the  same  detecton^e 
presented.  A full  description  of  the  IBSS  calibration  tests  and  results  for  all  radiometer  and  spectrometer  detect  rs 
is  presented  in  the  final  IBSS  calibration  report. 

?.i.  Calibration  equation  parameters 

Calibration  personnel  measured  dark  offset,  linearity,  absolute  responsivity,  and  measurement  uncertainty  for  the 
IBSS  spectrometer  and  radiometer  calibration  equations. 

Dark  offset 

To  apply  the  calibration  equation,  dark  offset  must  first  be  subtracted  from  the.  sensor  response^  Cotton 

personnel  determined  the  mean  dark  offset  prior  to  each  calibration  test  to  ogset<oirect  *e  resdTs 

Typical  radiometer  dark  offsets  were  approximately  8e+3  counts,  and  typical  spectrometer  dark  offsets  were 

approximately  le+3  counts. 

Linearity 

The  next  step  in  applying  the  calibration  equation  is  to  linearize  the  sensor  response.  The  linearity  calibranon 
provided  a*  mlmsfer^hnction  of  actual  response  to  ideal  linearized  response  throughout  the  sensor  dynamic  range^ 
Once  the  sensor  response  has  been  linearized,  a single  coefficient,  found  during  the  absolute  responsivity 
calibration  converts  linearized  response  to  measured  flux.  By  analyzing  linearity  independently  of  the  absolute 
responsivity  and  other  radiometric  parameters,  calibration  personnel  can  more  easily  identify  errors  m the  absolute 
cidibrarion  due  to  sensor  spectral  leaks  and  source  uncertainties.  In  addition,  since  the  linearity  function  covers 
S^c  range,  ffie  absolute  (extended)  source  need  not  cover  the  sensor  dynamic  range  in  the  absolute 

responsivity  calibration. 

The  ideal  source  for  a linearity  calibration  provides  a wide  range  of  flux  without  changing  the  spectral  ^atial, 
or  temporal  characteristics  of  the  flux.  The  SDL/USU  calibrator  offers  two  sources  for  the  linearity  calibration, 
the  Jones  source  and  the  collimator.  Both  sources  give  fluxes  proportional  to  their  aperture  areas,  but  only  the 
smallest  collimated  apertures  fit  entirely  within  the  fields  of  view  of  the  small  radiometer  detectors;  therefore,  the 
Jones  source  was  chosen  for  the  radiometer  linearity  calibration.  Because  the  Jones  source  failed  to  give  adequate 
siznal  over  the  spectrometer  dynamic  range,  the  collimator  was  used  for  the  spectrometer  linearity  calibranon. 
Calibration  personnel  varied  the  input  flux  in  known  ratios  with  the  set  of  calibrator  precision  apertures,  and  used 
multiple  source  temperatures  to  cover  the  dynamic  range  of  both  sensors. 
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The  radiometer  responses  to  each  input  flux 
we-e  offset  corrected  with  dark  responses 
plotted  versus  relative  flux,  and  fit  to  a piece- 
wise,  polynomial  iinearity-correcrion  function. 
Fig.  1 shows  the  results  of  the  linearity 
calibration  for  radiometer  detector  13,  which 
is  typical  of  the  radiometer  detectors. 
Linearity  uncertainties,  computed  as  the 
standard  deviation  of  the  curve-fit  residuals 
were  less  than  2.5%  for  most  detectors.' 
Similar  analyses  were  performed  for  the 
spectrometer  detectors,  which  also  showed 
linearity  uncertainties  of  a few  percent. 


Absolute  responsivity 


Fig.  1.  Radiometer  detector  13  linearity 
calibration. 
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absolute  responsivity  coefficient  Ustrate  the  method  used  to  determine  the 
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Responses  to  a number  of  known  fluxes  were  curve-fit  at  each  wavelength  by: 
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* (A) 


[RespL  (X)] 


(3) 


where  d>c(x)  - computed  spectral  radiance  in  W cm*2  sr*1  um'1  jt(\ i - , 

W cm  sr  pm  \ and  RespL(X)  - offset-corrected  and  “ counts/ 

TTie  offset-corrected  and  linearized  responses 
were  curve-fit  to  equation  3 at  each 
wavelength  to  give  the  absolute  spectral 
responsivity.  Fig.  2 shows  the  results  of  the 
absolute  calibration  for  detector  5.  Curve-fit 
uncertainties  are  also  shown  in  this  figure. 

As  described  in  equation  3,  the  absolute 
spectral  responsivity  is  given  in  radiance  with 
unitt  of  counts/W  cm'2  sr*1  pun*1.  Another 
useful  parameter  is  the  irradiance  spectra] 
responsivity,  which  is  the  absolute 
responsivity  in  flux  density  with  units  of 
counts/W  cm*2  pm*1.  This  irradiance  • 
responsivity  was  found  by  dividing  the 

r radiance  responsivity  by  the  effective 
neid  of  view,  a parameter  discussed  in  the 
spatial  domain  characterization  section  of 
this  paper. 


F\;.  2.  Spectrometer  detector  5 absolute  spectral 
responsivity  calibration.  K ^ 
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The  radiometer  absolute  calibration  was  similar,  except  that  the  source  flux  was  Moer^and 

^ve^  non-s^«n^^bwlut^^OTtf 

Tot  Si  detector-filter  combination.  Curve-fit  ^certainties  were  good,  and  no  spectral  errors  were  observed. 
Measurement  uncertainties 

The  calibration  equation  ^ i^Sistency  of 

^£SrS'  jsr  tiatw 

wnn  SneatabUity  The  total  calibration  accuracy  is  given  by  the  root-sum-square  combination 
square  combination  of  the  total  sensor  precision  and  total  calibration  accuracy. 

nark  noise  is  the  precision  of  individual  measurements  at  the  minimum  detectable  signal  level.  To 
rharacteme  the  darknoise  of  the  1BSS  radiometer  and  spectrometer,  calibration  personnel  collected  telemetry 
frilTrh.IBSS  filter  wheel  in  the  dosed  position  and  used  Fourier  techniques  to  compute  dark  noise 
^These  spectra  were  then  integrated  over  the  noise  bandwidth  to  compute  total  nns  dark  noise. 

These  spectra  contained  noise  from  the  50-Hz  (European)  power  distribunon  system,  which  amounted  £r 
Tnese  sp  c • . »r  was  assumed  that  this  noise  will  not  be  present  during  the 

*b°“r  , ,bSS  „d  wa3  therefore'  omitted  from  the  integrations  for  the  total  tins  dark  noise.  Typical 

rn  COW.  «*  typloof  spectrometer  dark  noise  was  l.+4  nns  counts.  The 

spectrometer  dark  noise  was  independent  of  grating  position. 

Uncertainty  from  the  long-term  drift  of  dark  offset  also  degrades  sensor  precision  at  the  bottom  of  the 
Calibration  personnel  recorded  dark  offsets  of  the  IBSS  radiometer  and  spectrometer  each  day 
dam^dle^on^er^d  To  measure  the  dark  offset  long-tenn  drift  Fig.  3 shows  the  range  of 
the  daily  means  of  the  dark  offsets  for  each  radiometer  detector.  Although  most  calibration  results  are 
2oo£d amphmde  the  complex  response,  dark  offset  is  presented  as  a complex  number  because 
offset  correction  oftiie  signal  responses  must  be  performed  before  conversion  to  amplitude.  The  ranges 
shown  indicate  the  uncertainty  due  to  long-term  drift  of  the  dark  ofiSeL 
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Fig.  3.  Dark  offsets  for  all  radiometer  detectors. 

Dark  noise  and  dark  offset  uncertainty  only  determine  the  precision  at  the  bottom  of  a sensor's  dynamic 
ranee  At  higher  flux  levels,  other  noise  sources,  such  as  photon  noise  and  digitizanon  noise,  must  also  oe 
considered.  The  signal-to-noise  ratio  (SNR)  and  sensor  long-term  repeatability  provide  an  Ration  of 
precision  throughout  the  entire  dynamic  range.  The  total  sensor  precision  can  be  determined  from  the  SNR 
and  the  long-term  repeatability,  a 5 follows: 


r 
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° Precision  " 
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SNR4 


Rep 


14) 


where  <7Pr#cj#(on  - total  sensor  precision,  SNR  * signal-ro-noise  ratio,  and  - long-term  repeatability. 


The  spectrometer  SNR  was  characterized  by 
recording  the  spectrometer's  response  to 
collimated  sources  of  various  sizes  and 
temperatures.  The  resulting  signals  were 
offset  corrected,  and  the  noise  for  each 
snapshot  was  corrected  to  remove  the  50-Hz 
components.  Fig.  4 presents  the  SNR  for  one 
spectrometer  detector.  As  expected,  the  SNR 
increased  with  increasing  response.  Similar 
analyses  were  performed  for  all  other 
spectrometer  and  radiometer  detectors. 


1**2  1**3  1***  1**5  1*’5  Jt*7  2**6  It  *9  j*-ic 


•neon'**  icauhtsi 

Fig.  4.  SNR  throughout  the  dynamic  range  for 
detector  5. 


To  measure  the  sensor's  long-term  repeatability,  calibration  personnel  recorded  die  sensor's  response  to  both 
the  IBSS  internal  source  and  the  calibrator  Jones  source  daily  throughout  the  calibration  period  It  was 
necessary  to  obtain  a comparison  between  the  sensor’s  response  to  both  sources  to  evaluate  the  stability  of  the 
IBSS  internal  source,  which  is  ultimately  used  to  verify  the  sensor’s  stability.  The  standard  deviations  of  the 
daily  internal  source  and  Jones  source  responses,  given  as  percentages  of  the  overall  means,  showed  tha<-  the 
response  to  the  IBSS  internal  source  was  repeatable  within  ±10  to  ±30%  for  the  radiometer  detectors,  and 
±5  to  ±17%  for  the  spectrometer  detectors.  The  response  to  the  calibrator  Jones  source  was  repeatable 
within  ±5  to  ±8%  for  the  radiometer  detectors,  and  ±1  to  ±5%  for  the  spectrometer  detectors.  The  Jones 
source  repeatability,  depending  on  the  detector,  was  up  to  a factor  of  4 times  better  than  die  internal  source 
repeatability.  This  indicates  that  the  IBSS  internal  source  itself  rather  than  the  sensor,  limited  the 
repeatability  of  die  internal  source  response. 


Pi?-  5 presents  the  total  calibration  accuracy  for  all  radiometer  detectors  with  one  radiometer  filter  Analyses 
for  all  filter-detector  combinations  showed  typical  accuracies  of  ±5  to  ±10%.  Fig.  6 presents  the  total 
calibration  accuracy  for  spectrometer  detector  5.  The  peak  at  8fim  is  due  to  a spectral  leak,  discussed  in  the 
spectral  domain  characterization  section  of  this  paper.  Typical  total  calibration  accuracies  were  ±5  to  ±12% 
for  the  spectrometer  detectors. 
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Fig.  5.  Calibration  accuracy  estimates  for 
radiometer  filter  0 and  all  detectors. 


Fig.  6.  Calibration  accuracy  estimate  for 
spectrometer  detector  5. 
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3.2.  Radiometric  Model  Parameters 


Spectral  domain  characterization 

The  radiometer’s  radiometric  model  includes  the  relative  spectral  responsivity,  which  is  the  peak-normalized 
responsivity  as  a function  of  the  wavelength  of  the  measured  radiation.  This  parameter  is  used  to  calculate 
tiie  effective  flux  for  the  absolute  calibration  and  to  interpret  on-orbit  data.  Calibranon  personnel  determined 
the  relative  spectral  responsivity  of  the  IBSS  radiometer  with  each  1BSS  filter,  using  an  externally  chopped 
blackbody,  grating  monochromator,  and  calibrator  Jones  source.  The  IBSS  internal  chopper  was  twned  off, 
the  onboard  signal  processor  was  bypassed,  and  the  output  was  fed  into  an  external  lock-in  amplifier.  The 
DC-restored  output  of  the  lock-in  amplifier  was  normalized  with  a spectrally  flat  external  reference  detector  to 
calculate  the  spectral  responsivity.  The  spectral  responsivity  was  then  normalized  to  its  own  peak.  Fig.  7 
gives  the  radiometer  relative  spectral  responsivities  for  each  of  the  IBSS  filters. 


The  spectrometer’s  radiometric  model  includes  grating  position  transfer  functions,  line  shape  characterization, 
and  spectral  leakage  analysis.  To  determine  the  IBSS  spectrometer  grating  posinon  transfer  functions, 
calibration  personnel  illuminated  the  spectrometer  with  an  external  monochromator  through  the  Jones  source 
at  approximately  ten  different  wavelengths  in  each  grating  order.  These  data  were  then  fit  to  linear  transfer 
functions  Fig.  8 presents  the  grating  position  calibration  for  each  grating  order.  The  end  points  of  each  line 
represent  the  passband  for  that  grating  order.  The  grating  position  calibration  uncertainties  were 
approximately  equal  to  the  design  spectral  resolution,  given  by  AX  - X/300  (X  - wavelength). 


The  line  shape  calibration  evaluates  the  spectrometer's  spectral  resolution  by  measuring  its  response  to  a 
monochromatic  source.  To  determine  the  IBSS  spectrometer  line  shape,  calibration  personnel  illuminated  the 
spectrometer  with  a 3.391-Min  helium-neon  (HeNe)  laser  through  the  Jones  source.  The  center  wavelength 
determined  by  this  calibration  agreed  with  the  theoretical  center  wavelength  within  the  grating  position 
calibration  uncertainty.  The  half-power  width  agreed  with  the  IBSS  specified  resolution. 


w«v»l*r>9in  Cunt) 


Setting 

Qr-cer 


: a 


2 

2 


Fig.  7.  Radiometer  relative  spectral  responsivity.  Fig.  8.  Spectrometer  grating  position  calibration. 


The  spectrometer  radiometric  model  also  characterizes  the  sensor's  spectral  purity,  which  is  its  ability  to 
measure  radiation  at  only  the  desired  wavelength.  Since  each  grating  order  diffracts  energy  of  a different 
specific  wavelength  onto  a given  detector  at  a given  grating  angle,  the  IBSS  spectrometer  detectors  are 
covered  by  order-sorting  bandpass  filters.  The  wavelength  for  higher  grating  orders  are  related  to  that  of  the 
first  grating  order  by: 
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where  = wavelength  for  order  N in  jim,  X, 
2,3,™).  


wavelength  for  order  1 in  /im,  and  N « the  grating  order  (1, 


The  order-sorting  filters  that  cover  the  IBSS  spectrometer  detectors  are  designed  to  select  radiation  from  only  the 
desired  spectral  order.  However,  at  certain  grating  angles,  some  order-sorting  filters  also  pass  radiation  of  an 
undesired  spectral  order.  This  results  in  the  spectrometer  detector  simultaneously  responding  to  radiation  from 
more  than  one  wavelength  for  a given  grating  angle.  Since  radiation  is  leaking"  to  the  detector  from  an 
tmdesired  wavelength,  it  is  said  to  be  the  result  of  a ’spectral  leak.’ 


To  identify  spectral  leaks,  calibration  personnel  compared  the  spectrometer's  relative  spectra]  responsiviries 
measured  using  blackbody  sources  at  different  temperatures.  Ideally  die  relative  spectral  responsivity 
measurement  is  independent  of  source  temperature.  But  for  grating  positions  with  long-wavelength  leaks  a low- 
temperature  source  gives  an  erroneously  high  relative  spectral  responsivity.  This  is  because  low-temperature 
sources  have  proportionately  more  energy  at  long  wavelengths,  which  make  the  long-wavelength  leaks  more 
significant.  Similarly,  for  grating  positions  with  short-wavelength  leaks,  a high-temperature  source  shows  an 
erroneously  high  relative  spectral  responsivity. 

Fig.  9 shows  the  superimposed  spectrometer 
detector  5 relative  spectral  responsivities 
measured  using  Jones  and  extended  source 
temperatures  from  185  to  1269  Kelvin. 

Three  spectral  leaks  are  identified. 

Calibration  personnel  quantified  these  leaks 
by  computing  the  ratio  of  the  absolute 
responsivity  at  the  leaked  wavelength  to  the 
absolute  responsivity  at  the  unleaked 
wavelength.  This  ratio  was  3%  for  the  leak 
at  5.49  ftm,  20 % for  die  leak  at  8.08  fim, 
and  9%  for  the  leak  at  8.33  fim.  Two 
additional  spectral  leaks  were  characterized 
in  die  other  four  spectral  grating  orders. 
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Fig.  9.  Spectrometer  detector  5 spectral  leakage 
characterization. 


Spatial  domain  characterization 

The  spatial  domain  characterization  is  best  illustrated  by  the  IBSS  radiometer  spatial  calibration-  therefore 
only  radiometer  data  is  discussed.  Calibration  personnel  measured  the  radiometer’s  spatial  responsivity  by 
posmomng  an  80+mad  collimated  source  at  0.1  mrad  increments  over  the  entire  focal  plane.  The  detector 
responses  at  each  location  were  offset  corrected,  linearity  corrected,  and  peak  normalized.  These  data  were 
then  analyzed  to  provide  field-of-view  response  maps,  relative  detector  positions,  scatter  coefficients  effective 
fields  of  view,  and  modulation  transfer  functions  (MTF).  A similar  calibration  was  performed  for  die 
spectrometer,  with  the  grating  stopped. 

Figs.  10  and  11  give  field-of-view  response  maps  for  radiometer  detectors  13  and  29.  These  mans  are  useful 
to  subjectively  evaluate  the  spatial  response,  especially  to  reveal  vignetting  problems  and  locate  sources  of 
scatter.  These  maps  are  logarithmic  plots  of  the  relative  spatial  responsibly,  with  each  contour  renresentinv  a 
of  a factor  of  2 below  the  preceding  contour.  Ten  contour  « *own  to  «p".S 

responses  down  to  .001  of  the  peat  Hi,  map  for  detecror  13,  which  is  typical  of  the^uTd 
detector;,  shows  that  the  major  scatter  areas  included  nearby  detectors  on  the  same  substrate  and  regions 
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u smali  detectors,  the  solid  angles  defined  by  *5  0 5 fr^r^ons  omslde  their  0.5-response 
More  than  half  of  their  response  to  a typically  5 tines  larger  than  the  design  solid  angle, 

. d 

The  effective  field-of-view  solid  angle  of  a sensor  The 

^ . This  correlation  allows  irradiance  responsmty  to  .oadally  ideal  sensor.  This  hypotheocal 
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Fig.  12.  Mean  spatial  scans  for  radiometer  detector 
13  in  the  X direction. 


Fig.  13-  MTFs  for  radiometer  detector  13  in  the  X 
direction. 
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Optical  Calibration  Objectives 
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Multiple  source  configurations  required  ► Multi-function  calibration  chancer 


SDL/USU  Low-Background  Calibration 


Optical  Sources  Provided  by  Multi-function  Infrared  Calibrators 
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Temporal  domain  characterizations 

Bench-mark  (long-term  repeatability)  characterizations 


Optical  Sources  Provided  by  Multi-function  Infrared  Calibrators,  cont 
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1.2  Methodology  for  spectral  characteristics  evaluation 

The  sources  of  knowledge  uncertainty  as  listed  in  Table  1.2  shall  be  evaluated  by 
testing  and/or  analysis,  and  Table  1.2  shall  be  filled  out. 

Table  1.2  Uncertainty  in  the  Prelaunch  Knowledge  of  Center  Wavelength  of  Operating  Bands 
(Band  No. : ) 


Sources  of  uncertainty 


1.  Spectral  transmissivity  of 
band  pass  filter 


Uncertainty/// m (3a)  Method  of  testing,  analy- 

r sis,  and  evaluation 

Budget  Design’ 


RSS  of  sources 


Source 

Measurement 

________________ 

| Nonuniformity 

; Air-to-vacuum  shift 

2.  Spectral 
tector  e 

responsivity  of  de- 
lements 

Source 

Measurement 

Nonuni  form ity 

3.  Spectral  reflectivity/transmis- 
sivity of  dichroic  mirror 

Source 

Measurement 

4.  Spectral  transmissivity  and 
reflectivity  of  optical  system 

Source 

Measurement 

5.  Total  spectral  responsivity 

Measurement 

Source  r 

Nonuniformity 

Total  (RSS) 

same  as  the  measurement 
uncertainty 


same  as  the  measurement 
uncertainty 


RSS  of  sources 


’ Present  design  status 


1.3  Supplementary  information  and  data  for  evaluation  of  spectral  characteristics 

The  following  information  and  data  of  spectral  characteristics  shall  be  submitted. 
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L3.7  Spectrum  and  numerical  table  of  total  responsi vity,  and  the  1st-,  2nd-,  and 
3rd~order  moments 

To  be  taken  at  the  both  ends,  the  middle,  a quarter,  and  three  quarters  of  band. 


2 Offset 


2.1  Requireiient  for  knowledge  of  offset 

The  instrument  offset  shall  be  determined  at  any  instance  of  the  life  within  the 
accuracies  listed  below  for  the  individual  gain  setting. 


Table  2.1  Requirement  for  knowledge  of  offset 


i 

Knowledge 

(3  cr ) 

High  Gain 

Normal  gain 

Low  gain-1 

Low  gain-2 

1 

■ 1 

msm 

±2  DN 

2 

■mi 

±2  DN 

N/A 

3N 

±4  DN 

±2  DN 

±2  DN 

3B 

±4  DN 

±2  DN 

±2  DN 

4 

±2  DN 

±2  DN 

mm 

* 

±2  DN 

±2  DN 

6 

±2  DN 

±2  DN 

BSH 

7 

1 

±2  DN 

±2  DN 

BUSH 

8 

mtm 

±2  DN 

±2  DN 

9 

i 

±2  DN 

±2  DN 

■SB 

10 

11 

12 

N/A 

1 

N/A 

N/A 

13 

14 

±11  DN* 
±12  DN* 

’ Offset  knowledge  related  to  only  instrument  temperature  variation  is  specified  in  2.1. 
Offset  knowledge  related  to  onboard  blackbody  is  specified  as  knowledge  of  temperature 
scale  in  4.2. 


3 Nonlinearity 

The  nonlinearity  of  input-to-output  relation,  NL.  is  defined  as  the  ratio  of  the 
deviation  of  the  input-to-output  curve  fro*  the  line  connecting  the  output  for  the  high 
level  input  and  the  offset  to  the  response  for  the  high  level  input  as  referred  to  in  the 
ASTER  Instrument  Specification. 

3.1  Requirement  for  knowledge  of  nonlinearity  . 

Table  3.1  Requirement  for  knowledge  of  VN1R  and  SVIR  nonlinearity,  NL 


Band  No. 

NL  knowledge  (3cr) 

1 

±1  X 

2 

±1  X 

3N 

±1  X 

3B 

±1  % 

4 

±1  % 

5 

±1  % 

6 

±i  % 

7 

±1  X 

8 

±1  X 

9 

±1  X 

Table  3.2  Requirement  for  knowledge  of  T1R  nonlinearity,  NL 


Absolute  Responsivity,  Gain  Ratio,  and  Temperature  Seal 
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Table  4.1  Analysis  of  uncertainty  in  the  responsivity  determination  of  VNIR  and  SffIR 


Phase  Source  of  uncertainty 


Fixed-point  blackbody 

Standard  spectrometer 

Variable  temperature 
blackbody 

Comparison  spectrometer 

Prelaunch  Integrating  sphere 

Radiometer  output  measurement 

Photomonitor  output 
measurement 

Air-to-vacuum  shift  of  center 
wavelength 

Subtotal  (RSS) 


Temperature  of  photomonitor 

Degradation  of  photomonitor 

Photomonitor  output 
Postlaunch  measurement 

Gravity  shift  of  lamp  radiance 

Radiometer  output  measurement 

(Nonuniform  contamination  of 
radiometer  aperture  optics) 

Subtotal  (RSS) 


Total  (RSS) 


Uncertainty  /%  (3cr ) 


Budget  Design 


Comments 


Responsivity  Ratio  and  Temperature  Scale  Difference  among  Bands 
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8 Stray  Light  Characteristics 


8.1  Requirement  for  stray  light  characteristics  and  its  . if  the 

Radiometer  response  may  change  for  radiant  sources  with  different  sues  even  IT 
radiance  is  exactly  same  due  to  stray  light  effect  of  radiometers.  The  stray  lig 
characteristics  is  defined  by  the  relative  response  difference  of  radiometer  w 
observing  the  earth  disk  and  the  standard  radiation  source  (integral mg  sphi J?  * ulped 
and  SWIR,  and  standard  blackbody  for  HR)  which  is  required  to  be  less  than  the  required 

values  listed  in  the  following  table. 


Table  8.1  Requirement  for  stray  light  characteristics 


Operating  band 

'Stray  light 
characteristics 

VNIR 

2% 

SWIR 

2X 

T1R 

IX 

The  stray  light  characteristics  shall  be  determined  with  the  knowledge  as  listed  in 
the  following  table. 

Table  8.2  Requirement  for  knowledge  of  stray  light  characteristics 


Operating  band 

Knowledge  of  stray 
light  characteristics 

VNIR 

IX 

SWIR 

IX 

TIR 

0.5X 

ERROR  BUD  GET  FOR  VNIR  & SWIR 
RES PONS  IV  I TY  CALIBRATION 


UNCERTAINTY  OF 
RESPONSIVITY 


r—  PREFLIGHT 
CALIBRATION 


IN-FLIGHT 

CHANGE 


i—  CAVITY  EHISSIYITY 
I-  PRIMARY  STANDARDS  — | 

(FIXED-POINT  BLACKBODY)  L TEMPERATURE 

r-  IAVELENGTH 
- RADIANCE  COMPARISON  —j 

L COMPARISON  MEASUREMENT 


1-  TRANSFER  STANDARDS 
(VARIABLE  TEMPERATURE 
BLACEBODY) 

j—  IAVELENGTH 
- RADIANCE  COMPARISON  — j 

L COMPARISON  MEASUREMENT 


£ 


CAVITY  EHISSIYITY 
TEMPERATURE 


- WORKING  STANDARDS 
(INTEGRATING  SPHERE) 


I—  LAMP  AND  CALIBRATION 
OPTICS  (A/B) 

- PHOTOMONITOR  I (A/B) 

- PHOTOMONITOR  II  (A/B) 
(IF  ANY) 


-c 

£ 


«—  STABILITY  OF 
RESPONSIVITY 


|—  PHOTOMONITOR  II (A/B) 
(IF  ANY) 


b LAMP  RADIANCE  (A/B) 


r-  PHOTOMONITOR  I (A/B) 


LAMP  RADIANCE 
REFLECTANCE 

BASE  TEMPERATURE  CHANGE 
OPTICS  TRANSMITTANCE 
TEMPERATURE  CHANGE 
TEMPERATURE  CHANGE 
DETECTOR  TEMPERATURE 
ELECTRONICS  TEMPERATURE 
f—  TEMPERATURE  CHANGE 


-c 


1_ 


DEGRADATION 


-c 


TEMPERATURE  CHANGE 
DEGRADATION  


b TRANSMITTANCE  OF 
CALIBRATION  OPTICS 
(A/B) 


I-  LAUNCH  VIBRATION 
GRAVITY  SHIFT 
b DEGRADATION 

IAVELENGTH  DIFFERENCE 
I-  CONTAMINATION 
DEGRADATION 
IAVELENGTH  DIFFERENCE 
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i—  BLOCKING  BY  CALIBRATION 
b NONUNIFORM  CONTAMI-  - OPTICS  ITSELF 
NATION  OVER  APERTURE 

(A/B)  L_  OUTGAS  A PLUME  DISTRIBUTION 


STABILITY  OF 
RESPONSIVITY 


-c 


DETECTOR  TEMPERATURE 
ELECTRONICS  TEMPERATURE 


IONIZING  RADIATION 
CONTAMINATION 
IONIZING  RADIATION 
CONTAMINATION 


8 Stray  Light  Characteristics 


8 1 Requirement  for  stray  light  characteristics  and  its  knowledge 

Radiometer  response  may  change  for  radiant  sources  with  different  sizes  evenjf  the 
radiance  is  exactly  same  due  to  stray  light  effect  of  radiometers.  The  stray  light 
characteristics  is  defined  by  the  relative  response  difference  of  r^»o«eter  VNIR 

observing  the  earth  disk  and  the  standard  radiation  source  (integrating  sphere  for  VNIR 
and  SfflR,  and  standard  blackbody  for  HR)  which  is  required  to  be  less  than  the  required 

values  listed  in  the  following  table. 


Table  8.1  Requirement  for  stray  light  characteristics 


Operating  band 

'Stray  light 
characteristics 

VNIR 

251! 

SfflR 

2% 

TIR 

IX 

The  stray  light  characteristics  shall  be  determined  with  the  knowledge  as  listed  in 
the  following  table. 


Table  8.2  Requirement  for  knowledge  of  stray  light  characteristics 


Operating  band 

Knowledge  of  stray 
light  characteristics 

VNIR 

IX 

SfflR 

IX 

TIR 
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Fig*  17.  Emissivity  as  a function  of  wavelength  for  various  snow 
densities*  according  to  the  model  of  Berger  [1979].  (Figure  7 of 
Berger  [1979].) 
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— OASIS-CC 


OASIS-CC  PRESENTATION 

Laboratory  for  Atmospheric  and  Space  Physics 
Operations  and  Information  Systems  Group 

University  of  Colorado  at  Boulder 


University  of  Colored© 

LASP  Spec*  Technology  Building 
Cempue  Box  WO 
Boulder,  Co  ftC30*-OWO 
Phone:  (303)  492  4792 
Fex:  (303)  4924444 


-OASIS-CC 


CU/LASP  Organization 


Laboratory  for  Atmospheric  and  Space  Physics 


Scientific 

Division 


Operations  and 
information 
Systems  Division 


CU/LASP  employs  100  professional  researchers  and  engineers 
and  60  undergraduate  and  graduate  student  researchers 


OASIS-CC 


CU/LASP  Flight  Projects 


LASP  scientists  snd  engineers  have  participated  In  the  following 
NASA  space  flight  missions 


Oft) King  Solar  ObMrvxtory  S 

Orbiting  G*ophy»k*l  Ob^nratory  4,  $ A $ 

Orbiting  Agronomical  Ob*»rv#.ory  2 

Miflnar  Vmhw  5 

Mtrtnar  Mara  € A 7 

Marl  nar  Ha  r»i 

Orbiting  Solar  Obaarvatory  8 

Atmoapiwa  Explorar  C A 0 

Voyagar  1 A 2 

Plonaar  Vanus  OfbHtf 


* Solar  Maaotphar#  Explorar 

* Spartan  Kail  ay 

* G«iii*o  Jupftar  Cfbftar 
Hubbk  Spa ca  Tabacopa 

* Upptr  Atmcipbara  Raaaarch  SaUilKa 
Mara  Ofaaarvar 

* Caaalni  Saturn  OrbSar 

* Earth  Obaarving  Sy*t*m 

* * 200  SubnOrbHal  Rockat  Exp«rlma«ia 


L Asterisks  denote  projects  for  which  LASP  built  or  Is  building 

one  or  more  Instruments  I 

LASP--— 


OASIS-CC 


What  is  the  OASIS  Project? 


The  Operations  and  Science  instrument  Support  (OASIS)  project  is  a 
long-term  effort  to  help  produce  operations  capabilities  that  con  support 
specs  science  missions  of  the  next  century 

- Past  funding  from  NASA  Office  of  Space  Science  and  Applications  and 
Goddard  Space  Flight  Center 

• Bv  providing  a comprehensive  concept  lor  future  mission  operations 
systems  we  can  enable  new  kinds  of  missions  by  Increasing  flexibility 
and  functionality  while  substantially  reducing  life-cycle  costs  and 
project  development  time 

We  have  implemented  portions  ol  the  OASIS  concept  In  software  under  the 
general  name  OAS1S-R/T 

- OASIS-CC  — OASIS  Command  and  Control,  for  monitoring  and 
controlling  science  instruments  and  spacecraft  during  test.  Integration, 
launch  and  on-orbit  operations 

- OASIS-PS  — OASIS  Planning  and  Scheduling,  for  scheduling 

instrument  and  spacecraft  operations  ^ ^ J 


V. 


IAS?. 


OASIS-CC 

Fundamental  User  Requirements 
for  OASIS-CC  Software 


• Usab  e by  scientists  and  engineers  who  aren't  programmers  and  who  dont 
want  to  be  programmers 

- Software  must  be  essy  to  install,  tailor  for  application,  and  operate 

• Must  perform  all  primary  functions  without  need  for  any  additional 
software  coding  and  without  need  for  other  costly  software  packages 

• Applicable  throughout  the  project  life  cycle: 

* Instrument  development,  test  and  Integration,  launch,  and  on-orbit 
operations 

• Extremely  flexible 

- Need  to  be  able  to  modify  data  definitions  and  processing  functions 
quickly  and  easily  without  writing  new  software 

- Built-in  support  for  a wide  variety  of  communications  protocols 

• Good  user  interface 

- Graphical  user  interface  that  can  be  tailored  by  users 

- Operations  language  that  is  more  English-like  and  which  eliminates  the 

Vmain  deficiencies  of  STOL  _ _ / 

IAS? 


OASIS-CC 


OASIS-CC 
FUNCTIONALITY  DESCRIPTION 


User  Interface 
CSTOL 

Language  processing 
Communications 
Data  processing 
Data  transfer 
Recording 
Command 
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Something  to  remember 


OASIS-CC  is  table  driven.  Most  of  what  follows  are 
generic  capabilities  of  the  system.  Users  only  need 
to  provide  the  contents  of  the  tables. 


IAS?. 
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OASIS-CC:  User  interface 


The  interface  usee  the  Transportable  Application  Environment  Plus 
(T  AE  +) 

- TAE+  is  a Motif-compliant,  portable  environment  for  developing 

and  running  interactive,  window,  text  and  graphical  object-based 
application  systems 

• TAE+  is  developed  and  supported  by  GSFC 

• TAE+  includes  a workbench,  an  intuitive  tool  that  supports  the 

design  and  layout  of  an  application's  user  interface 

- Code  (Ada  or  C)  generated  by  the  workbench  is  linked  with  the 

OASIS-CC  code  to  generate  the  executable  program 

Using  TAE+  a user  can  develop  simple  or  extremely  elaborated  user 
interfaces. 
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OASIS-CC:  User  interface  (cont.) 


• User  input  is  dons  via : 

• push  button 

- slider 

• form-filling 

- radio  button 

- check  box 

• menu  selection 

• The  user  can  also  input  CSTOL  statements  via  keyboard  entry 


J 
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• Data  in  tha  OASIS-CC  current  value  table  can  be  used  to: 

- Drive  alphanumeric  display 

- Animate  icons  (rotation,  distortion,  translation) 

- Drive  icons  that  represent  a system's  state 

- Drive  stripchart-like  plots 


JLASP. 
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OASIS-CC:  CSTOL 


- The  Colorado  System  Test  and  Operations  Language  (CSTOL)  Is 

derived  from  GSFC*s  STOL 

- Improvements  over  STOL: 

- A distinctly  English-like  syntax 

• The  ability  to  access  database  tables  through  a query  language 

- A mechanism  for  expanding  the  language  through  macros 

• Support  of  engineering  units 

- CSTOL  is  designed  for  scientists,  engineers,  ground  controllers  who 

develop,  test  and  operate  spacecraft  and  payloads 

- CSTOL  was  built  as  a test  for  many  of  the  requirements  for  the  Space 

Station  User  Interface  Language 

- CSTOL  accomodates  people  with  little  or  no  programming  experience 

- CSTOL's  English-like  syntax  makes  H readable  and  self-documenting 

________ •(«« 
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OASIS-CC:  CSTOL  (cont.) 


CSTOL  provides  users  with  the  means  to  perform  the  following  functions : 


• Evaluate  expressions,  where  variables  In  the  expression  can  be  data 

from  a spacecraft  or  instrument 

- Make  decisions  based  on  information  returned  by  the  spacecraft  or 

instrument 

- Initiate  and  control  procedures  written  In  CSTOL 

• Maintain  the  OASIS  database 

- Call  up  and  terminate  displays 

- Make  and  break  communication  links 

- Send  commands  to  the  spacecraft  or  instrument 
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OASIS-CC:  Communications 


- Generic  protocol  support  is  provided: 

• DECNET,  mailbox  and  RS-232  for  the  VMS  version 

• TCP/IP  (stream  socket)  and  RS-232  for  the  SunOs  version 

• Other  protocol  handlers  can  be  developed  if  required  by  an 

application  (example:  NASCOM  for  the  RHISE  application  and  the 
LDBP  application,  DADS/AOS  for  the  SSFP  DMS  testbed  application, 
16-bit  parallel  interface) 

• The  VMS  version  provides  an  IEEE-488  capability 
Future  developments: 

- IEEE-488  for  SunOs  version 
- 1 1 53  for  SunOS  version 
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OASIS-CC:  Data  processing 


• Stream  synchronization 

- Stream  decommutation  (super-commutation,  sub-commutation, 
packetized  telemetry) 

• Binary  data 

• Floating  point  data 

• ASCII  formatted  data  (I,  F or  A format) 

• Interfacing  to  a hardware  decommutator  may  be  done  in  the  near 

future  (concept  already  tested) 

• Conversion  from  raw  (unsigned  integer)  values  to  unitized  real  values 

• Conversion  from  raw  discrete  values  to  state  values  (like  ON,  OFF) 

• Limit  checking 

- High/Low,  Red/Yellow 

• Red  limit  can  trigger  the  execution  of  a CSTOL  procedure 

- State  check 

- Unsafe  state  can  trigger  the  execution  of  a CSTOL  procedure 

V-  Deha  check  A a / 
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OASIS-CC:  Data  transfer 


- Two  mechanism*  are  provided:  Bridge  end  Router 
. Both  mechanism*  uee  the  communication  aervice*  provided  by 
OASIS-CC 
Bridge: 

- Allow*  transfer  via  file  or  over  communication  link*  of 

processed  data  in  a format  defined  by  the  user 

- Useful  to  transfer  time-correlated  science  and  engineering  data 

for  quick-look  processing 

Receiver  | ______ 

•— » #1  I ” " bM-wa*  I ..  . " k 


Data 
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Xmitter  L 
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Handling 
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OASIS-CC:  Data  transfer  (cont.) 

Router. 

. BWIt^nd  over  communication  Unto 

. Allows  the  transfer  of  rsw  aaxe  ovc  __TnL 

. Allows  the  transfer  to.Sfffflihte 
.ul.msnt.  ^ 


atatememe  receive  - 


"Receiver  I 

«1 


CSTOL 

processor 
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OASIS-CC:  Recording 


Recording  of  downlink  data 

Raw  data  can  be  recorded  and  replayed 

»"  b.  (vl*  ths  Bridgs  cp.b» »,) 

. Comments  c.n  b.  sddsd  b,  Ih.  n.«  « mcortlng  dm.  to  qu.  (» 
the  recorded  date 


Event  messages  can  be  recorded 
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OASIS-CC:  Command 


- Examples; 


CSTOL 

•lew  grating  to  1800 
•lew  grating  to  1216.0  a 
•et  observation  list  to  5 
•et  entrance  slit  to  stellar 
move  extender  to  10.0  mm 
move  extender  to  1.0  cm 
eioie  gripper 


TRANSLATION 
=>  CC220F08 
=>  CC229F08 
=>  CC22060S 
=>  C 0220780 
=>  3FCC280C83 
=>  3FCC280C83 
*>  move  gripper  to  6.0  cm 
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OASIS-CC  SUPPORT 


Utility  programs 
Documentation 
Support  office 

Anomaly  reporting  and  configuration  management 
Release  documentation 
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OASIS-CC:  Utility  programs 


• Database- related  programs: 

- Load  Database:  from  ASCII  to  internal  representation 

• Dump  Database:  from  internal  representation  to  ASCII 

- Report  Database:  from  internal  representation  to  report  format 

- DDP  (Database  Development  Package):  a user-friendly 

database  builder  program,  using  TAE+  (in  development) 

- Parser-related  program: 

- Convert  Table:  from  ASCII  to  internal  representation 

• Event  log  file: 

• Dump  Events:  to  search  and  create  a printable  file  from  the 

event  log  file 


1ASP.« 
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OASIS-CC:  Documentation 
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OASIS-CC  Anomaly  reporting  and  release  documentation 


- Reporting  mechanism  existing  currently  on  the  SPAN  network: 

. Allows  the  users  to  report  anomalies  or  request  enhancements 
■ Each  report  is  automatically  assigned  a number 

- Users  can  refer  to  this  number  to  track  their  reports 

- The  reports  are  also  used  to  support  configuration  management 
-Each  new  release  is  documented  in  a release  note: 
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OASIS-CC  AS  A TOOL 


Examples  of  utilization 
Support  of  instrument  development 
Support  of  spacecraft  integration  and  test 
Support  of  flight  operations 
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OASIS-CC: 


Examples  of  utilization 


- UARS/SOLST1CE  instrument 

OASIS>CC  fi  used  to  support  instrument  functions!  test,  celibration, 
integration  and  flight  operations 


• JSC  Space  Station  Freedom  DMS  testbed 

OASIS-CC  was  used  in  four  nodes  of  the  testbed  (OMA,  OMGA,  APEM 
and  POiC  nodes)  located  at  JSC  and  at  MSFC 


• ESA  Astronaut  training 

OASIS-CC  is  used  to  access  MSFC's  Paylosd  Crew  Training  Complex 
from  ESTEC  in  Noordwijk  * 


- Long  Ouration  Balloon  Project 

OASIS-CC  will  be  used  along  with  OASIS-PS  to  acquire  balloon 
experiment  data,  TORSS  ODM  messages  and  issue  GCM  requests 


ASP. 
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OASIS-CC:  Examples  of  utilization  (cont.) 


• SOLCON  flight  operations 

From  ESTEC  in  Noordwijk,  OASIS-CC  was  used  to  monitor  and  control 
the  SOLCON  experiment  aboard  the  last  ATLAS  flight 


- DMSP  and  DSCS  ground  station  demonstration 

OASIS-CC  was  used  to  demonstrate  low-cost,  transportable  satellite 
operation  and  control  systems 

- EOS/SOLSTICE  H and  CASSINI/UVIS 

OASIS-CC  will  be  used  during  the  functional  tests,  calibration  and 
integration  of  these  two  Instruments 


V. 
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OASIS-CC:  Instrument  development  support 


Instrument  functlonel  teet 
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Validating  a Large  Geophysical  Data  Set:  /"?/3/f/ 


Experiences  with  Satellite-Derived  Cloud  Parameters 


■ i 


Ralph  Kahn,  Robert  D.  Haskins,  James  E.  Knighton, 

Andrew  Pursch,  and  Stephanie  Granger-Gallegos 
Jet  Propulsion  Laboratory,  California  Institute  of  Technology,  Pasadena,  CA  91109 
Abstract  1*  Introduction 


We  are  validating  the  global  cloud  parameters  derived  from  the 
satellite-borne  HIRS2  and  MSU  atmospheric  sounding 
instrument  measurements,  and  are  using  the  analysis  of  these 
data  as  one  prototype  for  studying  large  geophysical  data  sets 
in  general.  The  HIRS2/MSU  data  set  contains  a total  of  40 
physical  parameters,  Filling  25  MB/day;  raw  HTRS2/MSU  data 
are  available  for  a period  exceeding  10  years.  Validation 
involves  developing  a quantitative  sense  for  the  physical 
meaning  of  the  derived  parameters  over  the  range  of 
environmental  conditions  sampled.  This  is  accomplished  by 
comparing  the  spatial  and  temporal  distributions  of  the  derived 
quantities  with  similar  measurements  made  using  other 
techniques,  and  with  model  results. 

The  data  handling  needed  for  this  work  is  possible  only  with 
the  help  of  a suite  of  interactive  graphical  and  numerical 
analysis  tools.  Level  3 (gridded)  daia  is  the  common  form  in 
which  large  data  sets  of  this  type  are  distributed  for  scientific 
analysis.  We  find  that  Level  3 data  is  inadequate  for  the  data 
comparisons  required  for  validation.  Level  2 data  (individual 
measurements  in  geophysical  units)  is  needed.  A sampling 
problem  arises  when  individual  measurements,  which  are  not 
uniformly  distributed  in  space  or  time,  are  used  for  the 
comparisons.  Standard  'interpolation'  methods  involve  fitting 
the  measurements  for  each  data  set  to  surfaces,  which  are  then 
compared.  We  are  experimenting  with  formal  criteria  for 
selecting  geographical  regions,  based  upon  the  spatial 
frequency  and  variability  of  measurements,  that  allow  us  to 
quantify  the  uncertainty  due  to  sampling.  As  part  of  this 
project,  we  are  also  dealing  with  ways  to  keep  track  of 
constraints  placed  on  the  output  by  assumptions  made  in  the 
computer  code.  The  need  to  work  with  Level  2 data  introduces 
a number  of  other  data  handling  issues,  such  as  accessing  data 
files  across  machine  types,  meeting  large  data  storage 
requirements,  accessing  other  validated  data  sets,  processing 
speed  and  throughput  for  interactive  graphical  work,  and 
problems  relating  to  graphical  interfaces. 

KEY  WORDS:  large  data  sets,  validation,  satellite 
data  analysis 


NASA's  Earth  Observing  System  (EOS)  will  generate  vast 
quantities  of  data.  Hundreds  of  terabytes  of  data  will  be 
acquired  from  orbit  to  characterize  the  Earth's  environment 
with  the  kind  of  spatial  and  temporal  detail  needed  to  study 
climate  change.  Such  high  resolution  is  required  to  properly 
sample  the  non-linear  impact  of  small-scale  phenomena, 
which  can  make  significant  contributions  to  the  global-scale 
budgets  of  heat  and  momentum.  It  is  also  expected  that  the 
data  will  be  analyzed  not  just  in  the  traditional  manner, 
concentrating  on  a single  data  set  at  a time,  but  in  new  ways 
that  involve  routinely  comparing  data  sets  from  multiple 
sources.  Part  of  the  need  to  study  multiple  data  sets  comes 
from  a growing  appreciation  for  the  importance  to  global 
conditions  of  transports  across  boundaries  such  as  the  air- 
ocean  interface  (e.g..  Earth  System  Science  Committee, 
1988). 

We  are  undertaking  the  validation  of  cloud  parameters  derived 
from  the  High  Resolution  Infrared  Radiation  Sounder  2 
(HIRS2)  and  the  Microwave  Sounding  Unit  (MSU) 
instruments  aboard  the  NOAA  polar  orbiting  meteorological 
satellites.  The  instruments  provide  one  of  the  few  global 
measures  of  cloud  properties  extending  over  many  years. 
They  are  also  capable  of  obtaining  near-simultaneous 
constraints  on  the  physical  characteristics  of  the  atmosphere 
and  surface  needed  to  derive  cloud  properties.  One  goal  of 
this  work  is  to  learn  about  analyzing  large  geophysical  data 
sets  in  general. 

Radiances  from  the  HIRS2  and  MSU  instruments  have  been 
analyzed  by  Susskind  and  co-workers  using  an  algorithm 
that  accounts  self-consistently  for  the  first-order  physical 
quantities  affecting  the  emergent  radiation  (Susskind  et  al., 
1984;  1987).  The  standard  data  products  are  (1)  monthly 
mean  values  for  forty  meteorological  parameters,  including 
effective  cloud  amount  and  effective  cloud  top  height,  on  a 
grid  of  boxes  2 degrees  in  latitude  by  2.5  degrees  in 
longitude,  and  (2)  'daily  data'  with  twice-daily  temporal 
sampling,  a spatial  resolution  of  about  125  km,  and  spacing 
between  points  of  about  250  km.  The  monthly  mean  data 
are  referred  to  as  a Level  3'  (gridded)  product,  and  the  daily 
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data  is  called  a 'Level  2'  product  (individual  measurements 
reduced  to  geophysical  units)  (Space  Science  Board,  1982; 
EOS  Data  Panel,  1986).  The  size  of  the  uncompressed 
Level  3 data  is  about  4 MB/month,  whereas  the  Lxvel  2 
product  fills  about  25  MB/day  (750  MB/month). 

By  validation  we  mean  'developing  a quantitative  sense  for 
the  physical  meaning  of  the  measured  parameters,'  for  the 
range  of  conditions  under  which  they  are  acquired.  Our 
approach  involves:  (1)  identifying  the  assumptions  made  in 
deriving  parameters  from  the  measured  radiances,  (2)  testing 
the  input  data  and  derived  parameters  for  statistical  error, 
sensitivity,  and  internal  consistency,  and  (3)  comparing  with 
similar  parameters  obtained  from  other  sources  using  other 
techniques.  A study  of  this  type  was  performed  (or  sea 
surface  temperature  (Njoku,  1985),  and  our  project  is  one  of 
several  parallel  efforts  currently  underway  to  validate 
different  cloud  climatologies  (e.g.,  Rossow  et  al.,  1985; 
1990).  The  validation  effort  we  are  undertaking  introduces  a 
number  of  problems  that  may  be  of  interest  to  specialists  in 
computational  statistics,  such  as  the  INTERFACE 
community,  as  well  as  to  those  involved  in  research  directly 
related  to  interpreting  large  geophysical  data  sets.  This 
article  summarizes  the  key  data  handling  issues  we  have 
encountered. 


2.  The  Need  for  'Level  2'  Data 

Large  geophysical  data  sets,  such  as  cloud  climatologies,  are 
often  distributed  to  researchers  in  gridded  (Level  3)  form. 
This  can  reduce  the  data  volume  by  orders  of  magnitude 
relative  to  the  parameter  values  for  each  individual  sounding 
(Level  2),  and  provides  the  user  with  a 'spatially  uniform' 
data  product.  For  example,  Figure  1A  is  the  global, 
monthly-mean  cloud  amount  map  for  July  1979  from  the 
HIRS2/MSU  data,  in  the  original  2 degree  by  2.5  degree 
averaging  bins.  All  accepted  cloud  amount  data  from  the 
individual  atmospheric  soundings  that  fell  within  each 
geographic  box  were  summed,  and  mean  and  variance  values 
for  each  box  were  calculated. 

Several  problems  occur  when  using  Level  3 products  for 
validation.  First,  if  only  the  Level  3 parameter  values  and 
associated  variances  are  available,  there  is  no  way  to  assess 
how  much  of  the  reported  variance  is  due  to  inherent  non- 
uniformity  of  the  parameter  over  the  averaging  region. 
Essentially,  the  instrument  resolution  is  degraded  to  a scale 
comparable  to  the  box  size,  and  information  originally 
acquired  to  measure  smaller-scale  phenomena  in  both  the 
spatial  and  temporal  domains  is  lost.  For  example,  in  a 2 
by  2.5  degree  box,  the  surface  temperature  may  exhibit 
random  fluctuations  of  half  a degree  and  may  change 
systematically  by  several  degrees,  whereas  the  box  average 
variance  will  assign  all  the  variability  to  random  eiTor. 


We  encountered  a second  problem  when  making 
comparisons  among  Level  3 products  with  different  gridding 
schemes.  The  best  concurrent  cloud  climatology  available 
for  comparison  with  the  data  in  Figure  1A  was  derived  from 
the  Temperature  Humidity  Infrared  Radiometer/Total  Ozone 
Mapping  Spectrometer  (THIR/TOMS)  on  the  NASA 
Nimbus  7 satellite  (Stowe  et  al.,  1988;  1989).  The  standard 
THIR/TOMS  Level  3 iziz  product  was  binned  according  to  a 
global  500  by  500  km  grid  that  is  also  used  for  Earth 
radiation  budget  studies.  The  July  1979  HIRS2/MSU  Level 
3 data,  degraded  using  area-weighted  averaging  to  the 
THIR/TOMS  spatial  grid,  is  shown  in  Figure  IB.  We  then 
resampled  the  degraded  HIRS2/MSU  data  back  to  the  2 by 
2.5  degree  grid,  and  subtracted  it  from  the  original 
HIRS2/MSU  data  (Figure  IQ.  Note  that  the  differences  are 
nearly  as  large  as  the  range  of  the  signal,  with  both  positive 
and  negative  values.  The  pattern  of  differences  varies  with 
the  location  of  edges  in  the  original  data,  and  is  modulated 
by  the  relative  position  of  grid  boundaries.  Differences  are 
especially  large  at  high  latitudes,  where  the  spatial 
resolution  of  the  THIR/TOMS  grid  is  much  lower  than  that 
of  the  HIRS2/MSU  grid,  and  wherever  there  are  sharp  edges 
generated  by  cloud  patterns,  such  as  in  the  intenropical 
convergence  zone  and  monsoon  areas. 

With  the  Level  2 products,  we  have  access  to  physical 
quantifies  at  the  full  resolution  acquired  by  the  instruments, 
and  avoid  introducing  additional  artifacts  into  the  comparison 
between  data  sets.  Level  2 data  are  not  uniformly  distributed 
over  the  surface^  At  low  latitudes  there  are  gores  in  the 
HRS2  sampling  between  orbits,  whereas  at  high  latitudes, 
the  surface  is  heavily  oversampled.  Data  dropouts  and 
calibration  lines  occur  at  all  latitudes.  The  sample 
resolution  changes  by  more  than  a factor  of  2 from  nadir  to 
the  limits  of  each  scan.  As  a first  step  toward  making 
comparisons  among  Level  2 data  sets,  surfaces  that  take 
account  of  non-uniform  clustering  of  data  points  may  be  fit 
to  the  data.  We  have  begun  experimenting  with  locally 
adaptive  surface  fitting  techniques  (e.g.,  Renka,  1988),  and 
are  exploring  the  use  of  methods  that  generate  variance 
surfaces  together  with  each  fitted  surface  (Cresse,  1989,  and 
references  therein). 

Binning,  which  is  traditionally  used  to  make  comparisons 
among  global  data  sets,  is  performed  as  an  automatic 
procedure.  In  using  Level  2 data  for  validating  data  sets, 
geographic  sub-regions  of  the  globe  must  be  selected  for 
surface  fitting,  based  upon  some  criterion  that  evaluates  the 
density  of  points  relative  to  the  size  of  local  gradients  of  the 
parameter  field,  possibly  in  several  directions.  Figure  2 
illustrates  the  role  of  interactive  geographic  subset  selection 
a part  of  the  software  we  are  assembling  to  perform  the 
HIRS2/MSU  validation.  'HDF  in  this  figure  refers  to 
Hierarchical  Data  Format,  a transportable  file  format  that 
eliminates  all  but  an  initial  file  conversion  for  exchanging 
data  among  DEC,  Sun,  Macintosh,  and  other  machines  used 
in  the  validation  (NCSA  Software  Tools  Group,  1990). 
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This  allows  us  to  store  single  copies  of  data  files  on 
centrally  located  disks,  that  are  accessible  across  the  network 
to  machines  with  differing  architectures.  We  are  currently 
investigating  the  criteria  for  accepting  subsets,  choice  of 
method  for  surface  fitting,  and  methods  for  making  formal 
comparisons  among  surfaces  filled  to  data  from  different 
sources.  The  important  question  of  interpolation  in  the 
temporal  domain  we  set  aside  for  the  present. 

To  summarize:  in  spite  of  the  much  larger  volume  of  the 
Level  2 data,  relative  to  Level  3,  and  the  collection  of  issues 
related  to  the  spatial  and  temporal  sampling  of  Level  2 data, 
we  need  the  ability  to  access,  store,  and  process  Level  2 data 
for  (1)  studies  of  the  internal  consistency  and  precision  of 
the  data  set  and  (2)  comparisons  with  other  cloud 
climatologies,  that  are  involved  in  the  validation  of  the 
HIRS2/MSU  cloud  parameters.  We  anticipate  that  similar 
needs  will  arise  for  interdisciplinary  process  studies,  and  in 
work  directed  toward  using  observations  to  better  understand 
mesoscale  climatological  phenomena. 

3.  Tracking  Assumptions  in  the  Code 

Another  issue  that  bears  upon  the  degree  to  which  we  may 
perform  validation,  and  other  scientific  analysis  on  large 
data  sets,  is  our  ability  to  grasp  the  collection  of  constraints 
imposed  on  parameter  values  by  the  code  that  generates 
them.  An  assumption  embedded  in  a large  data  handling 
code  may  produce  results  that  hide  important  information  in 
the  data,  or  may  produce  patterns  in  the  data  that  could  be 
incorrectly  interpreted  as  scientifically  meaningful. 

We  are  experimenting  with  methods  of  charting  the 
collection  of  assumptions,  as  a way  of  calling  the  attention 
of  the  user  to  areas  where  the  code  may  influence  the  output 
parameters.  We  are  using  standard  charting  symbols  as 
much  as  possible  (e.g.,  Yourdon  and  Constantine,  1979). 
An  example  of  this  type  of  chan  is  Figure  3.  This  shows 
the  flow  of  control  and  the  flow  of  assumptions  made  in  a 
relatively  small  pan  of  the  HIRS2/MSU  analysis  code  that 
produces  Level  3 data  from  Level  2 products.  This  chan 
made  clear  the  number  and  complexity  of  the  assumptions 
involved  in  generating  Level  3 products,  and  it  played  a role 
in  our  assessment  of  the  value  of  Level  3 data  for  the 
validation  exercise. 

Charting  the  flow  of  control  provides  a needed  context  for 
the  constraints  placed  on  the  data.  These  chans  take  a step 
in  the  direction  of  making  it  possible  to  keep  track  of 
assumptions,  but  they  do  not  eliminate  the  work  involved  in 
carefully  assessing  the  meaning  of  derived  parameters. 

4.  Conclusions 

The  HIRS2/MSU  cloud  parameter  validation  effon  raises  a 
number  of  data  handling  issues  that  are  likely  to  arise 
frequently  when  scientific  analysis  is  attempted  on  large 


geophysical  data  sets.  We  need  Level  2 data  (individual 
measurements  in  geophysical  units)  (A)  to  perform 
comparisons  among  data  sets  with  different  sampling,  and 
(B)  to  understand  the  effects  of  spatial  and  temporal 
sampling  on  the  'average'  values  obtained  from  a single  data 
set.  The  need  for  Level  2 data  severely  complicates  data 
handling.  Among  the  areas  where  advances  would  be  most 
helpful  are: 

1.  Surface  fitting  software  for  data  distributed  non-uniformly 
in  2-dimensional  space,  and  ways  to  obtain  some  measure  of 
the  associated  variances. 

2.  Software  for  making  formal  comparisons  among  fitted 
surfaces  from  several  sources,  and  their  associated  variance 
surfaces. 

3.  Ways  of  documenting  software  and  data  files  so  they  may 
be  exchanged  and  used  by  others  easily. 

4.  Ways  of  documenting  the  assumptions  embedded  in 
retrieval  and  processing  algorithms,  so  a researcher  studying 
the  data  products  can  grasp  the  collection  of  constraints 
placed  on  the  output  data  by  the  code. 

5.  Additional  ways  of  storing  data.  For  a given  Level  2 
data  product,  we  need  readily  accessible  data  storage  capacity 
of  between  one  and  two  orders  of  magnitude  the  size  of  the 
basic  data  set,  for  intermediate  and  derived  products  that  are 
created  as  pan  of  the  validation. 

Several  longer-term  needs  include: 

6.  The  development  of  validation  procedures  that  are  easy 
enough  to  apply  so  that  it  will  be  feasible  to  generate  and 
access  a large  number  of  validated  geophysical  data  sets  for 
interdisciplinary  studies  of  all  types. 

7.  Ways  of  fitting  surfaces  to  data  values  distributed  non- 
uniformly  in  2-dimensional  space  and  in  time,  and  obtaining 
a measure  of  the  associated  variances. 

8.  Better  ways  of  discovering  patterns  and  surprises  in  high- 
dimensional data  sets. 

9.  Ways  of  fitting  hyper-surfaces  to  higher  dimensional  data 
sets,  and  techniques  for  studying  them. 

We  have  described  our  data,  the  collection  of  problems  we 
are  facing  in  the  validation  work,  and  our  approaches  to 
some  of  these  issues.  Solutions  or  partial  solutions  may 
exist  to  some  of  the  problems  that  are  not  widely  known 
outside  specialized  data  handling  and  computational  statistics 
communities.  We  hope  to  stimulate  experts  in  these  fields 
to  participate  in  the  effort  to  improve  our  understanding  of 
Earth  through  the  study  of  large,  geophysical  data  sets. 
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Figure  1.  The  Effect  of  Rebinning  on  Global  Cloud  Amount 
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Figure  2.  Level  2 Data  Analysis  Software 


Large  Data  Set  Validation  1 39 


last  revised:  04/1  (X91 


SET  UP  VARIABLES 
f • aelea  HIRS2  parameters  and  tone  intervals 
for  processing  (PROCESS.PARMS) 

*o  up  variables  (RDTOPO;  INTO 


HIRS2/MSU 
ILEVEL2  DAILY 
PARAMETERS 


(a 

vj) 


Check:  only  allow: 
90  <-  Lai  <»  90 
180  <*  Lon  <»  1 


(j 


Define  day  (not  sight  as; 
8.5  to  20.5  local  boors 


Only  include  data  fnxn  ' 
'good*  temp,  retrievals: 
TERR  >m  0 

in  avenges  of  all  parameters 
. EXCEPT  CLOUDS  J 


*'fonly  aD 

Vs200<! 


[ Only  allow  surf.  temp. 
: STEMP  < 350 


/R ej« 

IcL 


Reject  data  if  temp,  came 
climatology  (if  IERR  » 


Reject  dan  if  retrieved  SST 
differs  from  climatology  by 
^ 7 K or  more 


4. 


If  the  retrieved  SST  is 
between  between  5 and  7 K 
greater  (leu)  than 
climatology,  act  SST  to 
VjJinmology  + 5 K (•  5 K)  ) 


Only  allow  ozooe  values 
100  < OZONRT  < 600 
l dobaons 


Figure  3.  HIRS2  Level  1 to  3 Software  Overview  / Assumptions 


Set  dd.  - 0 if  the  need  for  dd. 
is  snail  (RMSNO  < 2)v  and 
1 -layer  dd.  correction  doesn't 
help  much  (HTCK>  0.7) 


Set  dd.  ■ 0 if  (1 ) dd  within  150 
mb  of  surface,  (2)  fit  is  good  w/o 
dd  (RMSNO < 3),  (3)  dd  frma> 
0.4,  and  (4)  window  channel  fiu 
well  (BTD  < 2) 


Set  layer  2 dd  • 0 if  (1 ) layer  2 
dd  ia  within  100  mb  of  surf  and 
layer  2 dd  docsn’  i help  the  fit 
(FITCK  > 0.9),  or  (2)  layer  2 dd 
fiact  > 0.4  and  FITCK  > 0.95 


Figure  3.  HIRS2  Level  2 to  3 Software  Overview  (Continued) 
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Where  We  Began: 

The  Cloud/Climate  Feedback  Problem 


Key  Measurements  Addressing 
the  Cloud-Climate  Feedback  Problem 

Microphysical  parameters: 

1.  p = d(ln  m)  / dT  dependence  of  cloud  water  (liquid  and  ice)  content  on 

temperature  (including  liquid  to  solid  transition 
temperature  and  small  ice  particle  concentrations) 

2.  y = d(ln  x)  / dT  dependence  of  cloud  opacity  on  temperature 

(implicitly,  dr  /dm;  dr/dT) 


Cloud  properties: 

3.  n(q,  w,  T)  dependence  of  cloud I amount  on  relative  humidity,  vertical 

velocity,  temp.,  and  other  environmental  parameters 

4.  cloud  top  height  dependence  on  temperature,  relative  humidity,  vertical 
velocity,  and  and  other  environmental  parameters 


5.  variability  in  cloud  behavior  (diurnal,  seasonal,  interannual;  land  & ocean) 
Cloud-related  processes: 

6.  distinguish  T from  dynamical  effects  on  clouds  (sign  & size  of  feedbacks) 

7.  determine  large-scale  conditions  for  formation  and  breakup  of  marine 
stratocumulus  (Cloud  Top  Entrainment  Instability) 

^ * - j r — •—  a ~ ' . ’T-  "* 

8.  determine  the  relationship  between  deep  convection  and  upper  troposphere 
water 


SENSITIVITY  OF  DERIVED  EFFECTIVE  CLOUD 
AMOUNT  TO  SURFACE  TEMPERATURE 


9N  I 
9T,  U 


9T. 


6»  Bv(T*)  e**®  + RJrt*+  f Bv(T)  e-'dt’  - Bv(Te)  e* 


On  the  right  side,  the  terms  in  the  denominator  account  for: 

(1)  direct  radiation  from  the  surface 

(2)  solar  radiation  reflected  by  the  surface 

(3)  emission  of  the  atmosphere  below  die  cloud  level 

(4)  emission  from  the  cloud  surface. 


The  terms  arc  wavelength  dependent 


Tlie  derived  cloud  amount  is  less  sensitive  to  surface  temperature  for 
higher  clouds.  This  occurs  because  as  the  cloud  elevation  increases,  the 
difference  between  Ts  and  Tc  increases,  so  only  a small  change  in  cloud 
amount  is  needed  to  effect  a large  change  in  radiance  at  die  detector. 


Pressure 


Pressure 


Definition  of  Validation 


By  ’Validation*,  we  mean  'developing  a quantitative 
sense  for  the  physical  meaning  of  the  measured 
parameters',  by: 


(1)  identifying  the  assumptions  involved  in  deriving 
parameters  from  the  measured  radiances 


(2)  testing  the  input  data  and  derived  parameters  for 
statistical  error,  sensitivity,  and  internal  consistency 


(3)  comparing  with  similar  parameters  obtained  from 
other  sources  using  other  techniques 


Identifying  the  Assumptions 


in  the  Measurements  (instrument,  technique) 


in  the  Algorithm  (retrieval  equations) 
in  the  Code  ('if  statements) 


C SFC  HIRS2  Level  2 to  3 Software  Overview  / Assumptions 

Ca)  — R.  Kahn 

MAIN44  las:  revised:  07 703/9 

®S^—  - initialize  variables 

( V - call  subroutines  J \ 

I ■■■■»■  1 nmrrp  ATFf«*-w  A 


R.  Kahn 

las:  revised:  07/03/91 


SET  UP  VARIABLES 
■ select  HIRS2  parameters  and  time  intervals 
for  processing  (PR OCESS_PARMS) 
s''<sei  up  variables  (RDTOPO;  INTn^ 


(!) 


HIRS2/MSU 
LEVEL  2 DAILY 
PARAMETERS 


f Check:  only  allow: 

- 90  <«  Lai  <=  90 
-\-180  <=  Lon  <=  180y 


Define  day  (not  night)  as: 
&-5  to  20.5  local  hours 


■ Only  include  data  from 
’good'  temp,  retrievals: 
IERR  >=  0 

in  averages  of  all  parameters 


READ  INPUT  DATA  N 
* read  daily  retrieval  data  from  input 
s.  tape  (RD  AIL Y;  PARSE JDATA) 


WRITE  OUTPUT 
(WRDATA) 


f CALCULATE  AVERAGES^V 
.for  each  parameter  in  each  bin,  and  noiej 
\bins  w/missing  data  (TIMAVG) 


EMIS  TEMP 

CLASS 

Land: 

>0.9  - 

Dry  Land 

<0.9  <275 

Snow 

<0.9  >275 

Moist  Soil 

Ocean: 

- >275 

Ocean 

SET  DAY  / NIGHT  FLAG'' 
(DAYNTTE)  > 


>0.7  < 275  Ice 
0.65  to  0.7  < 275  Ice  / Water 
< 0.65  < 275  Ocean 
Ocean:  TOPOG  in  bin  <=  0 


''SUM  ALL  THE  DATA^ 
• for  the  time  period  requested 
- for  each  geographic  bin  - 
- for  each  parameter  requested; 
and  accumulate  the  # of  entries 
(SUMDATA) 


If  temp  is  > 275, 
emissivity  < 0.9,  and  an  / 
surrounding  bin  is  ocear, 
classify  as  Dry  Land  j 
rather  than  Moist  Soil  J 


Reject  data  if  temp,  came  from 
climatology  (if  IERR  » 2) 


Reject  data  if  retrieved  SST 
differs  from  climatology  by 
. 7 K or  more  > 


If  the  retrieved  SST  is  ^ 
between  between  5 and  7 K 
greater  (less)  than 
climatology,  set  SST  to 
climatology  + 5 K (-  5 K)  . 


Accumulate  Day  and  Nighr 
Surface  Temperatures 
V (SUMTMP) / 


"Only  allow  ozone  values 
100  < OZONRT  < 600 
v dobsons  , 


Accumulate  Day,  Night,  ana' 
Day  + Night  Ozone 
(SUMOZO) 


r Accept  ozone  value  only  if  ^ 
measurement  sensitivity  is  high 
(1  deg  change  in  H9  brightness 
(03SENS)  changes  ozone  by 
^ less  than  50  dobsons).  ) 


/Only  allow  emissivity  values:  ] 
l 0 < SEMIS  < 1 J 


Reject  data  if  water  retrieval 
flag  is  bad  (IWATER  < 0) 


Reject  data  if  obs  and  computed 
Tb  in  Channel  S differ  by  more 
^ than 3 K (ABS  (DIF8)>  3)  J 


Accumulate  Surface 
Emissivity  from 
MSU  channel  1 
(SUMEMI) 


^Accumulate  Column  PpL\ 
Water,  Upper  Level  Ppt. 
Water,  and  Surf.  Pressure  for, 
“V^Ratio  (SUMPRCL^^ 


Reject  data  if  obs  and  computed 
Tb  in  Channel  10  differ  by  more 
than  3 K (ABS  (DIF10)  > 3) 


/ ; ; n 

[ Limits  on  min  and  max 
I temperatures  at  each  level  — 
not  implemented  j 

Z^All  Cloud  Fractions  are  the''1 
J sum  of  Cld.  Frs.  reported  ____ 
^ for  elds,  in  2 layers  J 

~ Only  allow  cld.  fract.  values 
in  layer  1: 

^ 0 <=  CLFR4  <=  1 j 

iy  - *V 

Reject  data  if  the  brightness 
temp,  fit  for  5 cld.  retrieval 
channels  (FIT)  > 5 K,  when  "" 
layers  1 and  2 are  included 


Accumulate  Temperature 
Profile  Data  at  up  to  20 
^ Levels  (SUMTRT) ^ 


'''Accumulate  Day  + Night,  DayX 
and  Night  Total  Cld.  Fractions 
and  Cloud  Top  Pressures,  and 
High,  Middle,  and  Low  Cld,  Frs., 
v and  albedo,  in  4 quadrants  S 
^V^JSUMC 


If  albedo  > 1,  it  is  set  to  1 
(RATIO  = 100.)  j 


Reject  data  if  the  need  for  cld. 
is  small  (RMSNO  < 5),  and 
2-Iaycr  cld.  correction  doesn’t 
help  much  (FIT  > 2) 


Skip  albedo  calculation  if  it 
is  night  (ANGSUN  > 75) 


Set  cld.  = 0 if  the  need  for  cld. 
is  small  (RMSNO  < 2),  and 
I-laycr  cld.  correction  doesn't 
help  much  (FITCK>  0.7) 


Set  cld.  > 0 if  (1)  cld  within  150 
mb  of  surface,  (2)  fit  is  good  w/o 
cld  (RMSNO  < 3),  (3)  cld  fract  > 
0.4,  and  (4)  window  channel  fits 
well  (BTD  < 2) 


Set  layer  2 cld  = 0 if  (1)  layer  2 
cld  is  within  100  mb  of  surf  and 
layer  2 cld  doesn' t help  the  fit 
(FITCK  > 0.9),  or  (2)  layer  2 cld 
fract  > 0.4  and  FITCK  > 0.95 


HIRS2/MSU  PHYSICAL  RETRIEVAL: 
OVERVIEW  of  CLOUD  PARAMETER  DERIVATION 


Level  lb  Radiances 
4 * 4 HTRS2  spots  + one 
I overlapping  MSU  sounding 


y 


f At  leas:  one 
octant  must  not  | 
be  completely 
Reload  covered^ 

/ — ' — > 

1 Assume  the  octant 

with  the  wannest 
11  Mm  brightness 
^jterop.  is  clearest-  J 

If  some  sounding? 
have  land  & others 
ocean  flags  in  a 4 x 
4 group,  do  one 
retrieval  each  over 
kjand  and  water,  j 


CALCULATE  tj 
r(the  cloud  correction  factor'' 
from  two  octants) 


last  revised:  07/03/91 


FIND  'CLEAREST  OCTANTS" 
Select  the  octant  pair  with  the 
wannest  window  channel 
radiance  (H8)  for  clear  column 
temperature  analysis. 
(SELQUD) 


1. 


/Assume  effective  cloud  amount, 
but  not  other  cloud  properties 
(particle  properties,  cloud 
pressure  level),  varies  over 
two  octants  (about  60  lan2). 


2.  / Ignore  cloud  edge  effects, 


& 


USE  MICROWAVE  TO  CORRECT 
IR  RADIANCES  FOR  CLOUD 
• estimate  the  expected  clear  column  radiances  in  IR' 
channels  HI3  and  H14  and  jiwave  channel  M2  using  i 
rive  transfer  model  initialized  with  first  guess  J 
- use  (observed  - model)  M2  to  correct 
H13  and  H14  for  cloud 


5 


/ 


f Assume  the  cloud  IR 
^reflectivity  is  zero 

^Neglect  differences  in 
surface  reflection 
/ between  clear  and 
V cloudv  conditions,  y 


First  Guess  Temp. 

Profile  from  GCM  & 
Climatology 
(Constrains  shape  of  the 
final  profile.) 

Assume  M2  accurately 
sounds  temperature  in  the 
same  region  as  H13  and 
H14,  and  is  not  affected  by 
iquid  water  drops  and  other 
v opacity  sources.  J 

Determinanon  of  which 
channels  get  cloud  correctic 
is  done  only  on  the  first 
^ iteration  of  the  retrievaL 

No  cloud  correction  is  applied^ 

s to  the  uwave  channels. 

— : ■ 

For  IR  window  channel* 
(peak  >1000  mb),  cld.  ccrr. 

^ is  always  applied. 

ror  IR  channels  sounding 
very  high  (peak  < 275  mb), 
v cld.  corr.  is  never  applied. 


Apply  cld.  corr.  for  all  channels^ 
from  lowest  up  to  the  first  for 
s which  (warm  - cold)  < 03 

Corrected  clear  col.  observed 
radiance  is  set  to 
[ warm  + n • (warm  - cold)  ] 


is  a weighted  ave. 
H13  & H14  values 


3 


Solve: 


T,^ 


Il(V) 


Ii(v)-I2(v) 
using  corrected  dear-column 
radiances  and  observed  radiances 
for  HI  3 and  H14. 
(ETACLD) 


If  tj  is  cloudy  (>4)  and 
(warm  - cold)  is  small 
^enough  (<S).  set  ~n  = 4^/ 


i < 0,  it  is  set  to  0, 


D 


\ 


1. 


(1)  problem  with  H8,  HI 3,  H14 
[ (warm  - cold)  < - 5.  ] 
or 

(2)  almost  full  overcast 

[ (warm  - cold)  > 8 and  T|  > 4 ' 


>5 


If  (warm  - cold)  is  small 
(<=  1),  and  (clear  • warm)) 
is  small  (<=  3),  set  T]  = 

^ - 0-5  and  call  it  dear.  J 


\ 


No 


Yes 


/ 


•/ 


/ 


FIND  CLOUD 
CORRECTION  LEVEL 
above  which  cloud  effects  are 
ignored. 
(CLDCOR^ 

T 

i 

2_/_ 

i correction,  or  if  clear 
, set  dear  col  rad. 

1 (warm  - cold) 


The  values  (warm  - cold)  & 
(dear  • warm)  used  to  test  r\ 
are  obtained  from  either  H13 
H14,  or  both.  If  the  test 
value  for  a channel  is  small 
(<  0.009),  it  is  ignored.  If 
both  are  small,  H14  is  used. 
To  obtain  t\  itself,  both 
V channels  are  always  used.  J 


Set  to  5;  set  IERR  to  -4. 
SKIP  TO  SECTION  C 
For  Ocean  cases  only,  use  First 
Guess  Temperature  Profile. 
For  Land,  reject  data. 


Use  first  guess 
tern  Dentures 


Assume  the  cloud  amount  ratio 
is  independent  of  wavelength 
across  the  4 and  14  pm  hanrU, 
and  is  determined  with  the 
assumotions  of  A3. 


^CALCULATE  CLEAR 
COLUMN  TEMPERATURE 
. PROFILE  ^ 


^ FIND  CLEAR  COL.  N 
BRIGHTNESS  TEMP. 

IN  7 CHANNELS 
(H2,  H4,  H13,  H14,  H15,  M3.  M4) 
or  the  2 wannest  octants,  using  for 
s — ^ cloud  correction. 


Assume  climatology 
represents  all  the 
information  about  the 
shape  of  the  clear 
column  temperature 
profile  not  contained 
m 7 channels. 


FIRST  GUESS 
TEMPERATURE 
PROFILE 


Assume  a Lambertian  surface, 
with  emissivity  for  land  areas 
of  0.85  at4  pm,  0.98  at  15 
pm;  for  ocean,  it  is  taken  as 
0.95  at  4 pm,  0.98  at  15  pm. 


ITERATIVELY  ADJUST 
THE  TEMPERATURE 
PROFILE 

to  fit  dear  column  temperatures 
from  7 channels  ^ 


(Ignore  any  cloud  effects^  2. 

^ onH8.H18.Hl9.  J v. 

/ s 

For  night,  take  ave.  of  3 

separate  surf.  temp, 
determinations.  For  day,  solve 
! simulL  for  surf.  temp,  and 
^reflectivity  with  H18  and  H19v 

' Reject  any  derivedN 
temp,  that  deviates  > 4.^ 
1-5  deg.  from  the 
mean  of  derived 


Use  weighting  to  compensate  far  the 
she  of  water  vapor  (H8),  reflected 
solar  radiation  CH18,  H19  daytime 
obs.),  doud  and  other  corrections 
\when  averaging  surf,  temp,  values. y 

'Use  climatology  for  sea\  ^ 
surf.  temp,  if  (1)  the  / 
spread  in  derived  temps.  / 
is  too  large  or  (2)  the  & 
final  result  deviates  > 5 
<deg  from  climatology. 


OBTAIN  SURFACE 
TEMPERATURE 
- (H8,  H18,  H19)  ^ 


/ Residuals  large  rN 

(1)  RMS  error  > 1 or 
(2)  calc.  M2  brightness  temp, 
deviates  from  obs.  by  > 1 deg> 


5-  / / 

/ / 

/ / 

r 7, 

'Only  3 or  4 iterations^ 
of  the  surface  temp, 
section  are  allowed  for 
each  retrieval 


'RETURN  TO  STEP  A.2> 
Use  most  recently  derived  temp, 
.structure  instead  of  GCM  and  . 
^s^climatology  inputs  •x'' 


© 


r CALCULATE 
EFFECTIVE  CLOUD 
AMOUNT  AND 
EFFECTIVE  CLOUD 
. TOP  PRESSURE 


intermediately  derived 

original  data  products 


Figure  3.  Interactive  Data  Extraction  and  Analysis  System 


THE  NEED  FOR  LEVEL  2 DATA 


3 COLOR  IMAGES  SHOW  HIRS2  JULY  1979  CLOUDS 

(1)  2 X 2.5  DEGREE  BIN, 

(2)  500  X 500  KM  BIN 
AND  (2)  - (-1) 


Original  Level  2 

(point}  data 
Sell 

• HD  F Format 

Original  Level  2 
(point)  data 
Set  2 

HDF  Format 


Exploratory  Data  Analysis  Acitvities 


Select  Parameter 
and  Subsets 

temporal,  error  condition, 
and  other  sampling 


Last  Revised:  04/09/91 


Original  Level  2 
(point)  data. 
SetN 

HDF  Format 


Gridding 


• / • 


Level  2 (point)  Data 
Display 

[sampling  locations  and 
statistics  shown] 


Interactive  Geographic 
Subset  Selection 


Level  3 (gridded)  ■ 
Data 

Image  Display  g 
[global  image  of  gj§ 
parameter  value] 


SubsetFiles 


HDF  Format 


Output  Hies,  and 
B & W and  Color 
Hardcopy 


FIGURE  A.6 


WIGSS  MENUS 


last  revised:  04/03/92 


FILE 


Open 

Close 

Save 

Save  Box 
in  Old  Dir 
in  New  Dir 
Save  Data 
as  Tabular 
asHDF 
as  Both 
Save  Region 
Print 

Postscript  Plot 
Session  Log 
Quit 


TOOLS 


EDIT 

Select  Box 

Define  New  Box 
Select  Previous  Box 
Select  Region 

Define  New  Region 
Select  Previous  Region 
Display  Level  2 Data 
Zoom  Box 

Create  Zoom 
Hide  Zoom  Box 
Show  Zoom  Box 
Remove  Points 
Clear  Display 
Reset 


COLOR 


Select  New  Palette 
Select  Default 
Color  Scale 

Create  Color  Scale 
Hide  Scale 
Show  Scale 


Thermodynamics 
Dewpoint 
Equiv.  Pol  Temp. 

Lift  Cond.  Level 
H20  Mass  Mix  Ratio 
PotenL  Temp. 

Sat  Mix.  Ratio 
Sat  Spec.  Hum. 

SaL  Vapor  Press. 
Specific  Humidity 
Vapor  Pressure 
Virtual  Temperature 
List  Data 
Level  3 
Level  2 
Contour  Plot 
Surface  Plot 
Histogram 
Variogram 
Create  Postscript  Plot 
with  Region  Outline 
without  Region  Outline 
Build  Procedure 


DISPLAY  PARAMETERS 


Session  Log 
Box  Info 
HDF  File  Desc. 
Intro  Msg. 
Postscript  Plot 


Parameter  1 
Data 

Standard  Dev. 
Counts 
Parameter  2 
Data 

Standard  Dev. 
Counts 
Parameter  3 
Data 

Standard  Dev. 
Counts 


Help  Menus 
Help  Variables 
Help  Procedures 
About  WIGSS 


Parameter  N 
Data 

Standard  Dev. 
Counts 


FIGURE  A. 7 


EDA  HIRS2/MSU  STANDARD  DATA  FILES  PROCESSING 


— Problem  of  multiple  machine  architectures 

We  converted  our  data  files  to  Hierarchical  Data  Format  (HDF). 
[Developed  at  NCSA  (National  Center  for  Supercomputer  Applications)] 

— Problem  of  data  documentation 

[How  are  the  fields  stored,  what  do  they  mean  (units,  definitions, 
assumptions)?] 

HDF  solves  a part  of  these  problems  (some  information  about  'data 
objects'  is  stored  in  HDF  files) 


What  We  Have  Learned  About  Standard  Data  Handling  Time  Scales: 

— To  discover  the  need  for  HDF,  learn  HDF,  and  apply  it  - ^ 1 year 

— Knowing  what  we  now  know,  to  rebuild  from  scratch  - ~ 6 months 

— To  create  HDF  files  for  a different  data  set,  of  comparable  complexity, 

in  an  arbitrary  format  - 

<*  2 months,  depending  on  the  documentation  and  hardware  availability 

— To  ingest  a different  data  set,  of  comparable  complexity,  that  is  already 

in  HDF  format  - 

^ 2 weeks  to  read  data,  test,  and  to  study  the  documentation 


For  data  analysis,  the  issue  of  assumptions  is  a large  one,  not  addressed  in 
the  standard  data  processing  (discussed  later). 


Partial  List  of  Software  That  Automatically  Reads 

Files  in  HDF  Format 

Currently  Available: 


NAME 

Platform 

Source 

Data  Scope 

Mac 

NCSA 

Image  Tool 

Mac 

NCSA 

Layout 

Mac 

NCSA 

Transform 

Mac 

Spyglass 

Format 

Mac 

Spyglass 

Dicer 

Mac 

Spyglass 

X-Image 

Sun* 

NCSA 

XDS 

Sun 

NCSA 

Reformat 

Sun 

NCSA 

APE  2.0 

Sun 

Ohio  State 

In  Development  or  Testing: 


Comments 

Display,  manipulate  arrays  & images 
Display,  animate  image  & color  bar 
Create  presentation  from  images,  text 
Combines  Data  Scope  & Image  Tool 
Similar  to  Layout 

Select  & view  sections  of  3-D  display 
Combines  Data  Scope  &,  Image  Tool 
Similar  to  Dicer 

Convert  FITS,  TIFF,  GIF,  SUN,  raw 
raster  files,  & x-window  dumps  to  HDF 

Object-oriented  prog,  language 
Interactive  graphics  prog,  language 


IDL  Sun  RSI 

IGSS  Sun  JPL/EDA  Interactive  Geographic  Subset  Selection 

netCDF  filter  Sun  NSF  Convert  netCDF  to  HDF 

* 'Sun*  also  runs  on  many  other  UNIX  platforms,  including  Apollo, 
Alliant,  Convex,  Cray,  DEC-ULTRIX,  and  IRIS  Workstations. 


HDF  Software  in 
an  Integrated 
Computing 
Environment 


HDF  File  with 
Scientific  Dataset 


dimensions 


CD 


90  by  100 


18.2,  103. C 


data:  "pressure”,  dim  1;  "a  v»I“,  dim  2:  "y  v*F 


data:  "pascals*,  dim  1:  -cm/scc".  dim?:  mcm/s*c' 


FORTRAN: 

INTEGER 

INTEGER 

REAL 

REAL 

INTEGER 

REAL 

shaped)  - 90 
shape (2)  - 100 


DFSDsetdias,  DFSDsetdatastrs.  DFSDaetdiaatrs 

DFSDsetdlascale,  DFSDputdaca 

pressl {90,  ipo> , pres s2 (90.100) 

deni <90, 100) , den 2 (90,100) 

shape (2),  ret 

xseale(90) , y scale (100) 


rec  " DFSDsetdlas (2,  shape) 

ret  - DFSDsetdatastrs ('pressure  1', 'Pascals', *E15. 9*  ••) 

ret  “ DFSOsetdiastrs (1,  'x  vel',  'ca/sec', 'FIO.O') 

r*c  ” DFSOsetdiastrs (2, 'y  vel',  'ca/sec', *F8.1M 

ret  - DFSDsetdlascale (1,  shaped),  xscale) 

ret  - DFSDsetdlascale <2,  shape(2),  yscale) 

ret  - OFSDadddata ( * SDex4 . hdf • , 2,  shape,  pressl) 

ret  - DFSDsetdatastrs ( 'pressure  2', 'Pascals', *E15  9*  • »» 
ret  - OFSDadddata ( • SDex4 . hdf • , 2,  shape,  press2)  * * 

ret  — DF5DcI#ar() 

[ret  - DFSDsetdatastrs ( 'density  1 ', 'g/cal', '115.9'  • 
ret  - OFSDadddata <'SDex4. hdf,  2.  shape,  deni)’  * 

ret  - DFSDsscdacastrs ('density  2', '9/ea3», 'E13.9'  •■) 
ret  - OFSDadddata ('SDex*. hdf,  2,  shape,  den2) 


HIRS2/MSU  HDF  LABEL 


FILE  IDENTIFIER  LENGTH:  5 
FILE  IDENTIFIER:  LABEL 
FILE  DESCRIPTOR  LENGTH:  1831 
FILE  DESCRIPTION: 

Description:  HIRS2/MSU  parameters  retrieved  using  the 

Goddard  Laboratory  for  Atmospheres  (GLA) 

Physical  Inversion  Algorithm  Saseltne  4.0. 

They  are  stored  as  individual  objects  of  an 
HDF  file.  These  files  are  the  standard  data 
source  for  most  data  analysis  applications . 

Host  of  the  parameters  delivered  on  the  original 
GSFC  tapes  are  included.  The  following 
parameters  were  eliminated  ( either  because 
of  questions  about  definition,  redundancy , 
or  problems  of  interpretation  of  the  values  ) : 
tau;  diat;  dlon;  np;  clchgt;  cldfrc;  ret vat (1) ; 
retwat  (5) ; humret(13);  rthick.  Thirty_seven 
paramaters  remain.  They,  are  listed  and 
defined  in  /edal/doc/hirs_daily/ rec.doc. 

Level  2 data  for:  06  jul  79,  0Z  - 24Z.  Platform:  TIROS 

Reference:  Susskind,  J.,  J.  Rosenfield,  D.  Reuter  and 

M.  T.  Chahine,  1984:  Remote  sensing  of 
weather  and  climate  parameters  from  HIRS2/MSU 
on  TIROS-N.  J.  Geophys.  Res.  89,  4677-4697. 

Contact:  Robert  Haskins 

Jet  Propulsion  Laboratory 

' Mail  Stop  183  - 301 

4800  Oak  Grove  Dr 
Pasadena,  CA  91109-8001 

(818)354-6893 


Regional  Boundaries  are:  Global 

Humber  of  Parameters:  37 
Parameters : 

YYMMDD,  HHMMSS,  QUADLATS,  QUAD LONS,  DNFLAG, 

LANDWTR  FLAG,  SAT  ZEN_ANGLE,  GEOPOT_THICX, 

HIRS8  OBS,  VI  S_R£FLEC?ANCS , SRFC_EMIS_MW,  SRFC_PRES 
TROP_PR£S_RTR,  SRFC_TMP_RTR,  SST_ANOMALY, 

Tiff  p’rofile_rtr,  QUAD_NUM_TMPS,  QUAD_FLAG, 

TMP— RTR  FLAG,  T3_RESIDUAL,  T3_RMS_TMP, 

RHUM  PROF__RTR,  PRECIPJWTR,  WATER_FLAG,  TB_RMS_WTR, 
HIRS8  TBDIF_WTR,  HIRS10_TBDIF_WTR,  CLCUD_SFRAC_L1 , 
CLOUD  TOP  ?RES_L1 , CLCUD_EFRAC_L2 , CLGUD_TOP_PRES__L2, 

rms_err_inccld7  rms_err_precld,  cloud_clear_parm, 

HIRS8_TBDIF__ CLD,  020NE__RTR,  03SENS 
Comment s : 

Binary  HDF  file  creation  date:  Mon  Nov  4 16:42:31  EST  1991 
Binary  HDF  file  created  on  a CRAY  Y-MP 


SOS  COUNT:  37 

SDS  DATA  DIMENSIONS:  4 x 44821 


* ’ WRSs'/JiSU  tiDF 

St)S  DATA  LABEL:  QUADLATS 
SDS  DATA  UNITS:  Degrees 
SDS  DATA  FORMAT:  F6,2 

OBJECT  REFERENCE  NUMBER*  9 
HDF  OBJECT  DESCRIPTION: 

°f  fOU-  *«’«-»  *■•<*•«,  *«  cloua  retri„sl 
Original  Name  » FIAT 


£PS  DATA  DIMENSIONS:  4 x 44821 
SDS  DATA  LABEL:  QUADLONS 
SDS  DATA  UNITS:  Decrees 
SDS  DATA  FORMAT:  F7 . 2 ‘ 

S c°Sg  * 

°f  *»*r*ntV for 

Original  Name  - FLON  

»S  DATA  DIMENSIONS:  1 x 44 82'*  ' ^ 

SDS  DATA  LABEL:  TMP  ERR  FIAG-”  * 

SDS  DATA  UNITS:  N/A  ~ 

SDS  DATA  FORMAT:  13 

5?F  OBjfCT  REFERENCE  NUMBER-  57 

HDF  OBJECT  DESCRIPTION: 

-?rpo!wag  £®5  temperature  retrieval. 

® IERR  ”*ans  successful 

vu  u«J'’xeVaI  *nd  retrieved  ter® 

S»s  used  for  water,  orone,  and 
clouc  retrieval. 

->  Negative  ISR R means  temp 

retrieval  failed  and  first  guess 

temp  and  moisture  is  used  , 

subsequent  cloud  retrieval. 

10QQ+X  Converged  on  K*’*  * • 

•ps,-.  .*  -teration  in  retrieval 

the  pir*rameser  iS  always  stored  as  1 on 
e tapes  that  we  receive  from  GSFC. 


1100 


-4 


-5 


Did  not  converge  after  9 iterations. 

•a  -.3  parameter  is  alwavs  stored  as  1 

tapes  chat  w,  ^.“."^GSFC 

Li  t ‘nfor2Jation  about  whether  or  not 
he  -etneval  converged  is  lost.) 

SST  retrieval  was  not  attemoted 
over  ocean,  climatology  SST' is  used. 

Tmn^Ui"  *®f  channel  2 was  large. 

-Snore  retrieved  temperatures  above  200  mb. 

t^U?iCi!ar;Lng  Was  not  attempted/ 
too  cloudy  to  do  a retrieval. 

?fg  * i degr*e  5 on  Tb  residual 
in  temp  sounding  channels,  or 
in  MW2  channel . 
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Not  used. 


EDA  HIRS2/MSU  STANDARD  DATA  FILES  PROCESSING 

Hierarchical  Data  Format 

We  have  developed  software  that: 

1.  Automatically  moves  HIRS2/MSU  physical  retrieval  data 

from  the  IBM  tape  archive  to  the  GSFC  Cray 

1 

2.  Automatically  converts  the  data  into  HDF  format,  including 
adding  file  labels  and  detailed  parameter  descriptions 

3.  Automatically  transfers  the  HDF  files  to  a user-specified 
remote  node  via  the  FTP  utility 

We  also  have  some  standard  utilities,  and  there  is  software  in  development, 

that  takes  HDF  files  and 

displays  HDF  label  information 

creates  floating  point  image  data  from  HDF  vector  data 

displays  floating  point  image  HDF  files  and  performs 
several  kinds  of  analysis 


EDA  HIRS2/MSU  STANDARD  DATA  FILES  PROCESSING 


© 


DATE2TAU 

(runs  on  GSFC  Cray) 

* Accepts  user-specified  time  for  requested  data 
“■  .^Convens  time  to  internal  clock  time  (tau) 


last  revised:  11/12/91 


?' 


IBM  Tape  Archive  List 
- obtain  desired  tape  name  and 
number  from  lookup  table  using 
_ internal  clock  time  (tau) 


© 


. HIRS2/MSU 
IBM  Tape  Archive 
(GSFC) 

- binary  IBM  records 


HERS2HDF 

(runs  on  GSFC  Cay) 

- Accepts  user  request 

• Obtains  retrieval  data  from  IBM  archive 

* Creates  file  header  and  documentation 
- Converts  IBM  data  files  to  HDF 

• Transfers  HDF  files  to  remote  node 


H2_PARM_SELECT 

(runs  on  remote  UNIX  node) 

- user  selects  desired  parameters 
‘ ®ror  checking  (currently  uses  the 
standard  GSFC  error 


\ FTP  over 

VrCP/IPnet 
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HIRS2/MSU 
HDF-SDS  PARAMETER  FILES 
(resides  at  remote  node) 
•most  parameters  from  IBM  tape 
archive,  translated  to  HDF. 
Name:  mmmddyy.Ldf 


HIRS2/HDF 

ARCHIVE 

25  MB/day 
(medium  TBD  - 
CD  ROM  possible) 


HIRS2/MSU 

HDF  SELECTED  PARAMETER  FILES 
- contains  Jat,  Ion,  time,  and  panun  values  (with 
related  flags  where  appropriate) 
working  files  - reside  temporarily  on  remote  node 
* user  selected  parameters  & dam 
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HIRS2/MSU 

hdf  selected  parameter  files 

• contains  lac.  Ion,  time,  and  panm  values  (with 
rehted  Hags  where  appropriate) 

. working  files  • reside  temporarily  on  remote  node 
• user  selected  parameters  & dates 
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FILTERIO 
[In  Development] 

(runs  on  remote  UNIX  node) 

- allows  user  to  select  first-order  processing 
writes  out  new  HDF  image-vector  file  or  ad< 
to  an  existing  one 


^RANSAMP 
, • random  sampling 


SPATIAL 

-averaging 


' - bin  average  & bin 
Vcount  / day  &.  month 


ZONEAVE 
■ zonal  average. 


f ARBSAMP 
Sr  arbitrary  sampling 


SUMMARY 


Validation  Issues 


Statistical  characterization  of  data  sets 


Finding  statistics  that  characterize  key  attributes  of  the 
data  sets 

Defining  ways  to  characterize  die  comparisons  among 
data  sets  (Scale  issues,  statistics,...) 


Selection  of  specific  intercomparison  exercises 


Selecting  characteristic  spatial  and  temporal  regions  for. 
intercomparisons 

Impact  of  validation  exercises  on  the  logistics  of  current 
and  planned  field  campaigns  and  model  runs 


Preparation  of  data  sets  for  intercomparisons 

Characterization  of  assumptions 
Transportable  data  formats 
Labeling  data  files 
Content  of  data  sets 

Data  storage  and  distribution  (EOSDIS  interface) 
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Presented  to 

The  EOS  Calibration/Data  Product  Validation  Panel 


Boulder,  Colorado 
April  7-10, 1992 
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UARS:  An  Introduction 


1)  Upper  Atmosphere  Research  Satellite 
•)  Launched  Sept.  1 991 

•)  In  planning  and  development  stages  since  late  1 970's 
•)  Measures  temperature,  chemical  species,  winds,  solar 
inputs 


2)  Similarities  to  EOS 

•)  Data  collected  and  processed  at  a Central  Data 
Handling  Facility. 

•)  Data  distributed  via  high  speed  network  to  Remote 
Analysis  Computers  at  investigator  sites 
•)  Science  Team  (users)  include  instrument  Pis  and 
theoretical  Pis. 


3)  Differences 

•)  UARS  is  a one  platform  mission 
•)  Highly  focused  on  upper  atmosphere  research 
•)  Quantitative  global  measurements  of  atmospheric 
parameters  ( as  opposed  to  determination  of  spectral  or 
spatial  contrast,  event  counting,  etc) 

•)  No  imagery 


UARS  Validation  Chronology 


1)  Validation  not  recognized  as  a fundamental  requirement  at 
the  outset  of  the  program,  (due  to  semantics,  oversight??) 

2)  A series  of  events  in  1988  focused  the  need: 

A)  Within  the  UARS  team  it  became  apparent  that  some 
additional  structure  was  required  to  unify; 

•)  Calibration 

•)  Algorithm  verification 

•)  Error  analysis 

•)  Correlative  measurements 

•)  A priori  knowledge:  (climatology,  theory,  modeling) 

B)  The  release  of  the  Ozone  Trends  Panel  Report 

3)  UARS  Validation  Working  Group  created  1989 

4)  Validation  Plan  completed  1991 

5)  Plan  Implementation  1991-92 


NASA 

Reference 

Publication 

1208 

1988 


Present  State  of  Knowledge 
of  the  Upper  Atmosphere  1988: 
An  Assessment  Report 


R.  T.  Watson  and  Ozone  Trends  Panel, 

M.  J.  Prather  and  Ad  Hoc  Theory  Panel, 
and  M.  J.  Kurylo  and  NASA  Panel  for 
Data  Evaluation 

NASA  Office  of  Space  Science  and  Applications 
Washington,  D.C. 

NASA  recognizes  the  need  for  timely  international  scientific  assessments  when  important 
new  information  becomes  available  as  has  occurred  since  the  last  major  international 
scientific  assessment  (WMO,  1986).  Reports  based  on  Nimbus  T satellite  Solar 
Backscattcr  Ultraviolet  (SBUV)  and  Total  Ozone  Mapping  Spectrometer  (TOMS)  data 
claimed  that  large  global  decreases  have  occurred  since  1979  in  the  total  column  of  ozone 
(about  1 % per  year)  and  in  its  concentration  near  50  km  altitude  (about  3%  per  year).  Data 
from  the  ground-based  Dobson  network  also  indicated  that  the  total  column  content  of 
ozone  had  decreased  on  a global  scale  significantly  since  1979,  although  to  a lesser  extent 
than  suggested  by  the  satellite  data.  Further,  there  has  been  a significant  amount  of  new 
research  focussed  on  understanding  the  extent  and  cause  of  the  depletion  of  ozone  in  the 
spring-time  over  the  Antarctic. 


NASA 

National  Aeronautic 
and  Space  Adminijtr 

Scientific  and  Techi 
Information  Divisior 


NASA  and  the  rest  of  the  scientific  community  believed  that  it  was  imperative  to  evaluate 
whether  the  Nimbus  7 satellite  data  had  -been- analyzed-correctly,  and  if  so,  whether  the 
reported  decreases  were  due  to  natural  causes  such  as  a decrease  in  solar  radiation  (from 
solar  maximum  in  1979  to  solar  minimum  in  1986),  the  1982  volcanic  eruption  of  Fl- 
Chichon,  or  the  1982  El-Nino  event,  or  whether  it  was  due  to  human  activities  such  as  the 
use  of  chlorofl uorocarbons  (CFCs).  Therefore,  during  the  fall  of  1986  NASA  decided  to 
coordinate  and  cosponsor  with  the  Federal  Aviation  Administration  (FAA),  the  National 
Oceanic  and  Atmospheric  Administration  (NOAA),  the  World  Meteorological  Organization 
(WMO),  and  the  United  Nations  Environmental  Program  (UNEP)  a major  review  of  all 
ground-based  and  satellite  ozone  data.  A panel  (the  Ozone  Trends  Panel)  composed  of 
eminent  scientists  from  federal  agencies,  research  institutions,  private  industry,  and 
universities  was  selected. 


Zen  And  The  Art  Of  Data  Validation  fcircA  fl* 


1)  What  Is  Data  Validation? 

A)  What  it  is  not. 

i)  Header  information 

ii)  Flags  marking  data  anomalies 

iii)  Limit  checks 

iv)  Verifying  that  the  software  didn’t  bomb 

v)  Documentation 

(These  are  all  Quality  Assurance  Issues.. .Necessary  but  not 
Sufficient) 

B)  Also,  What  it  is  not:  Comparing  Profiles  With 
Someone  Else.  ( A component  but  not  an  end  in  itself  ) 

C)  What  it  might  Be.  ( The  Process  of  Demonstrating  that  a 
Collection  of  Data  Represents  the  Real  Atmosphere  Within  a 
Quantifiable  Uncertainty) 

D)  What  it  always  is. 

i)  Overlooked  in  program  planning. 

ii)  Underestimated  in  terms  of  time,  effort  and 

resources  required. 

iii)  The  most  frustrating  part  of  the  mission. 

2)  Why  Is  It  Important? 

UARS  is  not  measuring  Qnyjhing  for  the  fjr§l  time,  it  is 
adding  to  a cumulative  base  of  knowledge  (in  some  cases , 
extensive)  and  therefore  must  be  compatible  with  existing 
and  future  sources  of  information 


Evolution  of  UARS  Data  Validation  Plan 

1)  Identification  of  issues  within  the  Validation  Working  Group. 

2)  Mandatory  requirement  that  each  investigation  team 
prepare  a plan  for  their  activities.  • 

3)  Creation  of  a "Generic"  plan  outlid§r  . " 

4)  Development  of  Investigator  specific  plan  outlines. 

5)  Review  of  Investigator  specific  draft  plans 

6)  Investigator  specific  final  plans  - 

7)  Collection  of  all  investigator  plans  into  overall  plan  - 


Pre/Fost  Launch  Validation  Activities 


1)  Pre-launch: 

A)  Formulate  Plans 

B)  Identify  resource  requirements 

C)  Begin  development  of  tools  and  procedures 

2)  Post-launch: 

A)  Organize  into  issue/parameter  specific  Validation  Sub- 
Groups 

•)  Temperature/Pressure/Altitude  registration 

•)  Trace  gas  concentration 

•)  Winds/Dynamics 

•)  Solar  Measurements 

•)  Data  gridding/mapping  procedures 

•)  Energetic  Particles 

B)  Investigator  teams  work  through  their  validation  plans 

C)  Report  findings 

D)  Take  corrective  actions  as  necessary  (instrument 
operation,  data  processing) 


GENERIC  P.I.  DATA  VALIDATION  PLAN  OUTLINE 

1.0  INTRODUCTION 

1.1  Brief  Experiment  Overview,  Including  Measurements  to  be  Validated 
and  Altitude  Ranges 

1.2  Brief  Validation  Criteria 

1.3  Validation  Approach 

- Approach  to  Level  1,  2,  and  3 validation  (e.g.  validate  most 
understood  parameters  first,  e.g.  temperature  and  least 
understood  parameters  last) 

2.0  DESCRIPTION  OF  EXPERIMENT  PHYSICAL  MODEL 

2.1  Instrument  Concept  and  Basic  Equations 

2.2  Forward  Radiance  Model 

- Radiative  transfer 

- Numerical  approximations 

- Physical  constraints  (e.g.  line  parameters  summary,  plus 
reference) 

2.3  Inversion  Approach 

- Brief  description  of  basic  approach 

- Constraint  methods 

- Numerical  approximations 

- Use  of  a priori  information  • - = 

3.0  DESCRIPTION  OF  INSTRUMENT  CHARACTERIZATION  AND  CALIBRATION 

3.1  Accuracy  and  Stability 

- IFC,  temperature  effects,  noise,  scale,  and  bias  error 
stability 

3.2  Spectral  Response  and  Registrations 

3.3  Spatial  Response 

- FOV 

- Off-axis  rejection 


Crosstalk 
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3.4  Pointing 

3.5  Electronics  Response 

- Amplitude  and  phase 

- Crosstalk 

3.6  Data  System  Errors 

- Gain  uncertainties 

- Digitization  errors 

3.7  Summary  of  Uncertainties  with  References 

4.0  ERROR  ANALYSIS 

4.1  Sensitivity  to  Errors  In  Instrument  Model 

4.2  Sensitivity  to  Errors  in  Forward  Radiance  Model 

4.3  Sensitivity  to  Inversion  Algorithm  Errors,  Including  A Priori 
Assumptions 

4.4  Spacecraft  Effects 

- Altitude 

- Attitude  rates 

- Ephemeris 

4.5  Uncertainties  Due  to  Data  Transmission  (e.g.  altitude 
Interpolation,  True  to  Earth  to  IAU) 

4.6  Estimate  of  Total  Measurement  Error 

5.0  PRE-LAUNCH  ACTIVITIES 

5.1  Instrument  P.I.  Obligations 

5.1.1  Define  post-launch  instrument  verification  procedures 

5.1.2  Creation  and  comparison  of  Level  3AL  data 

- Sample  test  atmosphere  for  3 days 

- Synthesize  radiances  with  production  algorithm  and  add 
errors 

- Perform  retrievals 

- Translate  to  standard  latitudes  for  comparison 
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5.1.3  Identify  and  develop  tools  and  methods  which  will  expedite 
post-launch  validation 

5.2  Theoretical  P.I.  Support 

- Contributions  by  theoretical  P.I.'s  that  will  aid  data 
validation 

6.0  POST-LAUNCH  ACTIVITIES 

6.1  Instrument  P.I.  Obligations  'r  ' 

6.1.1  Implement  Instrument  verification  procedure 

- Monitor  calibration  stability  (e.g.  scale  factor,  bias) 

- Verify  spectral  registration 

- Verify  spatial  response  characteristics 

- Evaluate  correlation  of  Instrument  signals  with  orbital 
events  such  as  (e.g.  south  Atlantic  anomaly,  other 
instrument  turn-on  events,  terminator  crossing) 

6.1.2  Update  error  analysis  as  necessary 

6.2  Theoretical  P.I.  Support  . 

- Contributions  by  theoretical  P.I.'s  that  will  aid  data 
validation 

6.3  Intercomparisons 

6.3.1  Guidelines 

- Number  of  comparisons  with  correlative  measurements, 
locations,  times,  coincidence  criteria  (time,  space) 

6.3.2  Climatology 

6.3.3  Correlative  measurements ■ ■ - 

6.3.4  Other  UARS  measurements  - ' ' 

6.3.5  theory  and  derived  products  ' •'  ' ;"-J 

6.3.6.  Targets  of  opportunity  (e.g.  ATLAS,  NDSC) 
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7.0  IMPLEMENTATION 

7.1  Detailed  Schedule  with  Milestones 

- Completion  of  on-orbit  Instrument  verification  In  procedure 
plan 

- Completion  of  on-orbit  Instrument  verification  In  procedure 
plan 

- Completion  of  initial  on-orbit  Instrument  verification 
procedures 

- Validation  of  Level  1 products 

- Validation  of  Level  2 products 

- Validation  of  Level  3 products 

7.2  Resource  Requirements 

- Personnel  and  equipment 

- Funding 

- Other 


— - ? — , 


Lessons  Learned 
(Or  Should  Have  Been) 

1)  Start  Early:  Should  be  part  of  initial  program  planning. 

2)  Put  in  adequate  resources  to  support  the  goals 

•)  If  you  want  fast  results,  expect  to  pay 

•)  If  you  want  to  save  money,  expect  to  wait 

3)  Maintain  better  coordination  between  Validation  . 
planning/implementation  and  Correlative  Measurement 
programs.  Make  sure  they  really  compliment  each  other, 

4)  Test  correlative  measurements  data  flow  and  validation 
procedures/tools  well  before  launch. 

5)  Divide  the  work: 

•)  Instrument  Pis  are  often  overworked  before  and 
immediately  after  launch. 

•)  Theoretical  Pis  are  often  under-utilized  during  this 
period. 

6)  Learn  from  the  successes  and  mistakes  of  others:  Be  willing 
to  adapt  as  time  goes  along. 

7)  Be  realistic:  (HQ  is  much  better  at  setting  goals  than  in 
providing  the  means  to  reach  them.) 


Implications  for  EOS 


1)  Use  UARS  as  a "Living  Laboratory"  in  an  attempt  to  identify: 

•)  what  works 
•)  what  doesn't 
•)  how  to  do  it  better 
•)  what  is  realistic 

2)  Make  sure  Correlative  Measurement  programs  are  planned 
with  validation  requirements  in  mind.  Make  sure  they  have 
appropriate  resources,  lead  time  and  coordination  with 
EOS. 

3)  Enlist  the  "user"  community  to  lend  a hand:  How  should  the 
work  be  divided? 

A)  Instrument  Teams  take  the  lead  in: 

•)  Calibration 

•)  Error  analysis 
•)  Level-1  data  products 
•)  Level-2  data  products 

B)  EOS  "Users"  take  the  lead  in: 

•)  Validation  program  planning 
•)  Working  group  coordination 

•)  Correlative  measurement  liaison 
•)  Level-3  data  products 

4)  Validation  activities  continue  for  the  life  of  the  program 

•)  There  is  an  initial  large  "impulse"  of  activities  with 
each  launch  * - 

•)  There  is  an  ongoing  "maintenance"  effort  ’for  the  life 
of  each  instrument 
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EOS  Project  Science  Office 
Data  Product  Validation  Policy 


DRAFT 
March  31,  1992 


DaU  Product  Vulidotlou  Policy 
March  31,  1992 


INTRODUCTION 

EOS  is  a planned  15  year,  multiple  instrument/platform  in  1 ““jj"  JJteB 
Planet  Earth  (HTPE)  program  designed  to  monitor  cjj^es  in  the  ear  derive 
Numerous  users  of  EOS  data  will  rely  on  accurate  EOS  data  d erive 

higher  generation  data  products.  These  data  products  and  the  resui  8 
scientific  analyses  will  serve  to  guide  environmental  and  y’ 

The  scientific  community  will  rely  on  the  veracity  of  the  data  Products 
developed  in  part  because  of  our  validation  policy  for  those  products,  and  in 
part  on  the  basis  of  the  scientific  reputation  of  the  investigators  who 
responsible  for  those  products. 

In  past  satellite-based  scientific  investigations,  data  product  validation  has 

encompassed:  (1)  quality  control  checks  on  raw  data;  ( 2 radiance  or 
community-consensus,  peer-reviewed  algorithms  that  transform  th  J 
reflectance  measurements  obtained  from  sensors  Into  geophys  ca  v » 

and,  (3)  comparison  of  data  products  derived  from  satellite  measurements  wi 
data  products  independently  derived  through  techniques  from  orbiting, 
airborne,  and  ground-based  instruments. 


REQUIREMENTS  LEVIED  BY  THE  1988  EOS  ANNOUNCEMENT  OF  OPPORTUNITY 

Validation  of  the  data  products  is  established  by  comparing  data  products  with 
measurement  values  acquired  by  conventional  measurement  and  *"aly***  „ 

approaches.  This  experiment  validation  must  be  Included  in  the  Calibration 
Plan  provided  in  the  proposed  Instrument  Investigation.  The  Data  Product 
Validation  Plan  must  define  the  correlative  measurements  and  in-orbit 
calibration  plan  which  establishes  conformance  to  the  EOS  ProjectDataProduct 
Validation  strategy.  The  Instrument  observables  usually  will  be  interpreted 
as  physical  parameters,  and  are  represented  as  data  products . Validation  of 
the  data  products  is  established  by  comparing  data  products  with  those 
acquired  by  conventional  measurement,  analysis,  and  other  approaches. 

Specifically,  the  Data  Product  Validation  Plan  at  a minimum  must  include: 

(1)  A description  of  independent  measurement  and  analysis  approaches  to  be 
used  in  experiment  validation  and  how  the  validation  data  products  are 
to  be  compared  to  the  instrument-derived  data  products. 


(2)  A description  of  how  the  calibrations  of  instruments  used  in  the 
validation  network  will  be  compared  to  the  calibration  of  the 
instruments  in  space. 

(3)  An  estimate  of  the  accuracy  and  precision  required  In  the  validation 
data  products  so  that  they  will  be  useful  for  this  investigation. 

(4)  An  estimate  of  the  frequency,  duration,  location,  and  any  appropriate 
special  observing  conditions  required  for  the  data  validation 
measurements. 

(5)  Description  of  EOS  validation  measurement  programs  and  the  relationship 
between  EOS  validation  measurement  requirements  and  supporting  major 
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national  and  international  science  field  measurement  campaigns,  such  as 
FIFE,  GEWEX,  TOGA,  etc. 

EOS  PROGRAM  OFFICE  DATA  PRODUCTS  VALIDATION  DEFINITIONS  AND  POLICT 

According  to  the  EOS  program  office  an  EOS  data  Product  of  level  J 
considered  to  be  validated  when  several  criteria  are  level  1 to 

algorlthms^us^pass^preflight^algorithm'validatio^review^  as  must  the 

calibration  techniques  used  to  determine  the  calibration  coefficient  . 
rlesSng  LS  algorithms  must  pass  a Peer  Calibration  Review  process. 

This  oerspective  for  data  product  validation  does  not  include  the  comparison 
If  JoTdSiSd  data  products  with  independently  derived  non-EOS  data  products 
obtained  through  truth  co-located  measurements.  This  omission  does  not  I p y 
that  the  EOS  program  (1)  does  not  recognized  the  importance  of  these 
verification  activities;  (2)  anticipates  that  these  verification  activities 

will  not  take  place;  or,  (3)  does  not  encourage  that  £Stl»  co_ 

activities  take  place.  In  fact,  campaigns  to  compare  EOS  data  with  truth 
located  measurements  are  viewed  by  the  EOS  program  office  as  ?" 
vehicle  In  broadening  the  scientific  community’s  interest 
ramification  of  removing  these  activities  from  under  the  data  product 
validation  umbrella  is  that  correlative  measurement  campaigns  are  not  planned 
to  be  funded  by  the  EOS  program. 

The  EOS  Program  Office  definition  of  data  product  validation  forces  *"at™“ent 
investigators  to  more  fully  understand  their  instruments  and  algori  J 

placing  more  importance  on  preflight  calibration  and  characterization  tests 
that  represent  instrumental  flight  operations,  instrumental  mathematical 
models,  and  algorithm  verification.  It  alsopromptslnstr^entlnvestigators 
and  data  producers  to  examine  more  closely  their  criteria  for  either  accepting 
or  rejecting  a particular  data  6et. 


EOS  PROJECT  SCIENCE  OFFICE  POLICY 

While  it  is  the  policy  of  the  EOS  Project  Science  Office 

identified  in  the  Announcement  of  Opportunity  are  still  useful,  there  are  few 
funds  available  to  do  more  than  verify— via  peer-reviewed  processes— the 
suitability  of  algorithms.  A measurement-based  algorithm  ^ification  Process 
likely  will  be  over  a rather  limited  time  frame  and  for  a limited  set  of 
environmental  conditions  for  most  of  the  data  products.  Still  to  b 
determined  is  how  to  deal  with  short-comings  in  a given  algorithm  after  “!  r 
official  acceptance,  whether  these  short-comings  are  due  to  incomplete  capture 
of  knowledge  or  due  to  a change  in  environmental  parameters. 
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INTRODUCTION 


Synergistic  use  of  EOS  data  requires  that  instruments  produce 
compatible  measurements,  even  when  several  s®**s°rS/fs?  ® 
used.  The  Project  must  develop  a technique  that  Yields  congruous 
Level  1 data  products  when  the  instruments  are  calibrated  by  the 
individual  sensor  buildert.  The  approaches  being  developed  to 
accomplish  this  are  round-robin  laboratory  comparisons  and 
exposure  of  instruments  to  a common  source  after  fina  . 

calibration  but  previous  to  sensor  integration  onto  the  fligh 
platform.  * 


In  addition,  there  exists  the  perception  that  all  instruments 
will  degrade  in  orbit,  each  at  its  own  characteristic  rate.  By 
knowing  how  the  instruments  compare  on  the  ground  before  launch, 
the  earliest  in-orbit  comparisons  will  assist  in  establishing  ow 
these  instruments  have  changed  during  launch.  The  combination  of 
the  long-term  data  sets  then  can  be  used  to  improve  our 
understanding  of  each  of  these  data  sets.  Our  primary  approach 
to  supplementing  the  individual  instrument  calibrations  for 
accomplishing  this  requirement  of  EOS  is  described  in  the  Cross- 
calibration  Plan. 


In  some  sense,  absolute  calibration  is  not  required  for  this 
activity.  In  principle,  stable  and  precise  calibrations  could  be 
used  to  meet  these  objectives.  Nevertheless,  experience  has 
demonstrated  that  absolute  calibrations  are  the  only  reliable 
approaches  for  accomplishing  stable  and  precise  calibrations. 
Cross-calibration  has  been  added  to  supplement  instrument 
absolute  calibrations  as  the  approach  to  making  congruent  data 
sets. 

Cross-calibration  was  made  an  EOS  baseline  requirement  as  defined 
in  the  1988  Announcement  of  Opportunity  (AO).  Each  Instrument 
Investigation  is  required  to  allow  for  such  activities. 

There  are  several  pre-flight  instrument  calibration  alternatives: 


(1)  Bring  all  instruments  to  a single  facility  where  final 
radiometric  and  geometric  calibration  will  be  validated. 
This  might  provide  the  best  calibration,  but  it  could  be 
very  expensive  and  establish  delays  in  getting  the  flight 
instruments  delivered. 

(2)  Have  a transportable  system  that  will  be  carried  to  the 
location  where  the  instruments  are  being  calibrated.  This 
transportable  system  would  be  used  to  validate  the  local 
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calibration  system  and  assure  more  compatibility  between 
systems.  This  offers  many  of  the  advantages  of  the  first, 
and  fewer  of  the  disadvantages,  . 

(3)  Depend  upon  each  instrument  builder  to  provide  the 
transfer  of  the  calibration  through  analysis  and  testing 
traceable  to  NIST  sources.  This  approach  is  how  commonly 
used,  and  generally  suffers  from  a lack  of  adequate 
documentation.  The  results  depend  very  much  upon  the 
specific  people  performing  the  calibration  and  the  project 
requi rements . 


From  a logistical  standpoint  a single  calibration  facility  or  set 
of  sources  could  lead  to  difficulties  in  launch  scheduling.  One 
cannot  calibrate  instruments  until  they  have  been  built. 
Calibration  is  done  as  the  last  activity  before  shipping  for 
integration.  The  use  of  a single  set  of  sources  or  a single 
facility  could  lead  to  real  difficulties  in  meeting  the  launch 
schedule.  Cross-calibrations  before  instrument  delivery  also 
interfere  with  normal  Project-contractor  management  interfaces. 


Thermal  detectors  for  satellite  radiometry  always  should  be 
calibrated  in  a vacuum.  Therefore,  vacuum  calibration  facilities 
should  be  the  norm  for  calibration  on  most  of  the  EOS 
instruments.  Such  a facility  will  need  to  accommodate  any  of  the 
instruments,  and  certain  benefits  result  if  the  facility  is  large 
enough  to  accommodate  the  entire  EOS  satellite.  Sources  for 
calibration  will  operate  in  a vacuum.  The  sources  must  be 
mounted  precisely  within  the  instrument  f ield-of-view. 

For  EOS,  a calibration  scheme  has  been  proposed  that  consists  of 
several  portable  radiometers,  each  optimized  for  a certain 
spectral  region.  It  is  proposed  that  these  radiometers  be  used 
in  each  instrument  manufacturer's  facility  for  comparison  of  the 
instrument  calibration  source  scales.  We  refer  to  these  as 
portable  or  traveling  radiometers. 

Great  strides  have  been  made  in  the  past  years  in  detector— based 
precision  radiometry.  For  the  visible  portion  of  the  spectrum 
quantum- response  detectors  are  now  available  that  have 
uncertainties  on  the  order  of  0.1%.  There  is  a high  probability 
that  comparable  accuracies  can  be  achieved  at  wavelengths 
extending  to  1500nm  in  the  next  several  years.  Thermal  detectors 
operated  at  room  temperature  are  accurate  to  0.1%  for  high  input 
power  levels  and  1%  for  lower  power  levels.  Cryogenic 
radiometers  are  now  available  with  uncertainties  approaching 
0 .025%  at  modest  power  levels.  Thi s technology  can  be  used 
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directly  in  the  construction  of  high-accuracy  radiometric 
instruments  or  indirectly  in  the  calibration  of  st^le 
instruments.  These  technologies  could  be 

verification  of  the  manufacturer's  calibration  source  sea  . 

There  are  pre-launch  plans  for  the  careful  cross-calibration  of 
the  various  laboratory  sources  using  portable  spectroradiometers 
and  for  a final  cross-calibration  of  the  instruments  themselves 
at  the  spacecraft  integration  facility. 


ROUND-ROBIN  CROSS -CAL I BRAT I ON 

During  instrument  construction,  the  prime  means  of  caparison 
should  be  through  the  circulation  of  transfer  radiometers.  These 
would  compare  the  working  targets  that  are  used  in  f 

calibration  of  individual  instruments.  The  primary  function  of 
these  detectors  is  to  verify  the  calibration  of  sources  that  are 
used  to  calibrate  EOS  instruments  with  VIS/NIR  channels  (e.g. , 
MODIS-N,  ASTER,  MISR).  There  is  no  perceived 

circulation  of  standards  for  spectral  or  spatial  calibration, 
these  topics  can  be  handled  through  the  use  of  standard 
procedures . 

Radiometers  used  as  transfer  standard  radiometers  must  be 
to  be  stable,  and  their  use  must  be  documented  through  an  error 
budget  analysis. 

The  AM  Observatory  is  scheduled  to  be  launched  in  June,  1998,  and 
instruments  will  be  delivered  beginning  two  years  before  launch. 
The  cross-calibration  radiometers  must  be  available  by  the  summer 
of  1994  to  support  two  years  of  testing  before  the  instrument 
delivery. 


CROSS-CALIBRATION  AT  INTEGRATOR’S  SITE 

The  primary  objective  of  the  cross-calibration  at  the 
integrator's  site  is  to  determine  the  instrument -to- instrument 
bias  when  each  instrument  is  looking  at  a well-controlled 
radiation  field.  This  approach  can  establish  the  responsivitity 
of  one  instrument  to  another,  but  may  not  be  useful  in  setting 
the  absolute  calibration  scale  of  any  one  of  them. 
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The  EOS  cross-comparison  setup  must  accommodate  a variety  of 
instrument  fields  of  view  and  aperture  sizes,  as  well  as  operate 
over  the  full  0.4  pm  to  15.4  pm  waveband.  Only  radiometric 
comparisons  will  be  made.  Absolute  calibration  of  the  instruments 
shall  be  performed  by  the  instrument  builders  prior  to  cross- 
comparison.  The  requi rements  for  cold  space  view  (i.e.,  4K  cold 
pi ate)  are  TBD  for  cross-comparison. 

Cross-comparison  will  occur  at  the  spacecraft  integrator's  site. 
The  integrator  must  provide  support  for  cross-comparisons  in 
their  integration  and  test  flow  procedures.  It  is  not  necessary 
to  accomplish  an  observatory  level  (all  instruments  at  once) 
cross-calibration,  and  most  calibrations  should  be  performed 
during  thermal  vacuum  testing.  The  Panel  recommendation  that 
there  be  separate  calibration  sources  for  visible/near  IR  and 
thermal  IR  calibrations.  For  thermal  IR  the  panel  recommended  a 
more  extended  source,  not  an  integrating  sphere. 


Problems  of  cross-calibration  at  the  spacecraft  integrator's 
facility  include  tight  schedules,  difficulty  in  developing  well- 
characterized  targets  of  an  appropriate  common  aperture,  and  the 
problem  of  controlling  the  setup  and  surroundings.  There  must  be 
adequate  time  and  facilities  for  detailed  functional  testing  in 
thermal  vacuum. 


CONCLUSIONS 


[TBD] 
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